From dev-return-13556-apmail-falcon-dev-archive=falcon.apache.org@falcon.apache.org Tue Aug 4 11:07:30 2015 Return-Path: X-Original-To: apmail-falcon-dev-archive@minotaur.apache.org Delivered-To: apmail-falcon-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A62241824B for ; Tue, 4 Aug 2015 11:07:30 +0000 (UTC) Received: (qmail 93023 invoked by uid 500); 4 Aug 2015 11:07:30 -0000 Delivered-To: apmail-falcon-dev-archive@falcon.apache.org Received: (qmail 92976 invoked by uid 500); 4 Aug 2015 11:07:30 -0000 Mailing-List: contact dev-help@falcon.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@falcon.apache.org Delivered-To: mailing list dev@falcon.apache.org Received: (qmail 92963 invoked by uid 99); 4 Aug 2015 11:07:30 -0000 Received: from Unknown (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 04 Aug 2015 11:07:30 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id D8B60DA363 for ; Tue, 4 Aug 2015 11:07:29 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 3.832 X-Spam-Level: *** X-Spam-Status: No, score=3.832 tagged_above=-999 required=6.31 tests=[HEADER_FROM_DIFFERENT_DOMAINS=0.001, HTML_MESSAGE=3, KAM_LAZY_DOMAIN_SECURITY=1, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RP_MATCHES_RCVD=-0.149] autolearn=disabled Received: from mx1-us-west.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id 3TAkf5k9vy2Z for ; Tue, 4 Aug 2015 11:07:28 +0000 (UTC) Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx1-us-west.apache.org (ASF Mail Server at mx1-us-west.apache.org) with SMTP id 65333205B9 for ; Tue, 4 Aug 2015 11:07:28 +0000 (UTC) Received: (qmail 92952 invoked by uid 99); 4 Aug 2015 11:07:27 -0000 Received: from reviews-vm.apache.org (HELO reviews.apache.org) (140.211.11.40) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 04 Aug 2015 11:07:27 +0000 Received: from reviews.apache.org (localhost [127.0.0.1]) by reviews.apache.org (Postfix) with ESMTP id 5D516D905A; Tue, 4 Aug 2015 11:07:26 +0000 (UTC) Content-Type: multipart/alternative; boundary="===============8450482070495792144==" MIME-Version: 1.0 Subject: Re: Review Request 36538: Falcon Unit which supports Submit and Schedule of jobs (contributed by Pavan) From: "Pallavi Rao" To: "Pallavi Rao" Cc: "Falcon" Date: Tue, 04 Aug 2015 11:07:26 -0000 Message-ID: <20150804110726.4206.73242@reviews.apache.org> X-ReviewBoard-URL: https://reviews.apache.org/ Auto-Submitted: auto-generated Sender: "Pallavi Rao" X-ReviewGroup: Falcon X-Auto-Response-Suppress: DR, RN, OOF, AutoReply X-ReviewRequest-URL: https://reviews.apache.org/r/36538/ X-Sender: "Pallavi Rao" References: <20150723111739.1579.94382@reviews.apache.org> In-Reply-To: <20150723111739.1579.94382@reviews.apache.org> Reply-To: "Pallavi Rao" X-ReviewRequest-Repository: falcon-git --===============8450482070495792144== MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/36538/#review94044 ----------------------------------------------------------- Ship it! Ship It! - Pallavi Rao On July 23, 2015, 11:17 a.m., Pallavi Rao wrote: > > ----------------------------------------------------------- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/36538/ > ----------------------------------------------------------- > > (Updated July 23, 2015, 11:17 a.m.) > > > Review request for Falcon and Pallavi Rao. > > > Repository: falcon-git > > > Description > ------- > > Submitted to Review Board on behalf of Pavan as he is on vacation for the 3 days. > > Falcon unit will be able to help to validate the process, feed and cluster xml's and as well as workflows of oozie. It will also help to submit schedule of jobs and check the job status as well. Falcon Unit supports two modes > 1) Local Mode : It will bring up local oozie , use local file system and uses Local Job Runner to run the jobs > 2) Cluster Mode: Falcon unit Api's can also be run by pointing to external oozie, hdfs and jobtracker. > Documentation of falcon unit is provided in https://issues.apache.org/jira/browse/FALCON-1296 > > > Diffs > ----- > > client/src/main/java/org/apache/falcon/client/AbstractFalconClient.java PRE-CREATION > client/src/main/java/org/apache/falcon/client/FalconClient.java 555bdb7 > common/src/main/java/org/apache/falcon/entity/parser/ClusterEntityParser.java 59b0910 > common/src/main/java/org/apache/falcon/entity/store/ConfigurationStore.java b5f531a > common/src/main/java/org/apache/falcon/util/DateUtil.java PRE-CREATION > common/src/main/java/org/apache/falcon/workflow/util/OozieConstants.java PRE-CREATION > hadoop-dependencies/src/main/java/org/apache/falcon/hadoop/JailedFileSystem.java 7156bbd > oozie/src/main/java/org/apache/falcon/oozie/OozieEntityBuilder.java 9ca0ac1 > oozie/src/main/java/org/apache/falcon/workflow/engine/OozieClientFactory.java 622238a > oozie/src/main/java/org/apache/falcon/workflow/engine/OozieWorkflowEngine.java 4085b8f > oozie/src/main/java/org/apache/oozie/client/LocalOozieClientBundle.java PRE-CREATION > oozie/src/main/java/org/apache/oozie/client/LocalProxyOozieClient.java PRE-CREATION > pom.xml 2900bc4 > unit/pom.xml PRE-CREATION > unit/src/main/java/org/apache/falcon/unit/FalconUnit.java PRE-CREATION > unit/src/main/java/org/apache/falcon/unit/FalconUnitClient.java PRE-CREATION > unit/src/main/java/org/apache/falcon/unit/FalconUnitHelper.java PRE-CREATION > unit/src/main/java/org/apache/falcon/unit/LocalFalconClientProtocolProvider.java PRE-CREATION > unit/src/main/resources/META-INF/services/org.apache.hadoop.mapreduce.protocol.ClientProtocolProvider PRE-CREATION > unit/src/main/resources/core-site.xml PRE-CREATION > unit/src/main/resources/deploy.properties PRE-CREATION > unit/src/main/resources/localoozie-log4j.properties PRE-CREATION > unit/src/main/resources/log4j.xml PRE-CREATION > unit/src/main/resources/mapred-site.xml PRE-CREATION > unit/src/main/resources/oozie-site.xml PRE-CREATION > unit/src/main/resources/startup.properties PRE-CREATION > unit/src/test/java/org/apache/falcon/unit/FalconUnitTestBase.java PRE-CREATION > unit/src/test/java/org/apache/falcon/unit/TestFalconUnit.java PRE-CREATION > unit/src/test/java/org/apache/falcon/unit/examples/JavaExample.java PRE-CREATION > unit/src/test/resources/cluster-template.xml PRE-CREATION > unit/src/test/resources/infeed.xml PRE-CREATION > unit/src/test/resources/input.txt PRE-CREATION > unit/src/test/resources/outfeed.xml PRE-CREATION > unit/src/test/resources/process.xml PRE-CREATION > unit/src/test/resources/workflow.xml PRE-CREATION > webapp/src/test/java/org/apache/falcon/resource/EntityManagerJerseyIT.java 47b51fe > webapp/src/test/java/org/apache/falcon/resource/ProcessInstanceManagerIT.java 6e58064 > webapp/src/test/java/org/apache/falcon/util/OozieTestUtils.java 02d1011 > > Diff: https://reviews.apache.org/r/36538/diff/ > > > Testing > ------- > > > Thanks, > > Pallavi Rao > > --===============8450482070495792144==--