falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jean-Baptiste Onofré ...@nanthrax.net>
Subject Re: Falcon Unit
Date Thu, 02 Apr 2015 10:49:33 GMT
+1,

I like the idea.

Regards
JB

On 04/02/2015 12:04 PM, Karan Kumar wrote:
> Hi Falcon dev
>
> As falcon has a bunch of handcrafted xmls ,this results in manual errors
> such as typos, giving bad arguments, xml errors etc while deploying a new
> job.
> For validating the xmls as well as checking the job is getting the correct
> set of configs, a mock run is needed in a full fledged setup of
>   falcon/hadoop/oozie. This I feel is a overkill.
>
> I propose that we start work on falcon unit which will intialize
> falcon/hadoop/oozie in local mode and run the job locally to test the
> configs and also can be extended to validate input and output datesets.
> This will really help in easily onboarding to falcon jobs as in a matter of
> minutes u can test your process.
>
> Have created a task on jira:
> https://issues.apache.org/jira/browse/FALCON-1133
>
> Willing to take this up if the community thinks it will add value.
> Thoughts?
>
> Thanks
> Karan
>

-- 
Jean-Baptiste Onofré
jbonofre@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com

Mime
View raw message