falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Srikanth Sundarrajan <srik...@hotmail.com>
Subject RE: Falcon Unit
Date Thu, 02 Apr 2015 10:44:04 GMT
This is a fantastic idea. Many developers who are using falcon currently to build their processes,
find it challenging to test & verify their apps. 

A huge +1 for this.

Thanks much for volunteering to take this up.

Srikanth Sundarrajan

> Date: Thu, 2 Apr 2015 15:34:30 +0530
> Subject: Falcon Unit
> From: karankumar1100@gmail.com
> To: dev@falcon.apache.org
> Hi Falcon dev
> As falcon has a bunch of handcrafted xmls ,this results in manual errors
> such as typos, giving bad arguments, xml errors etc while deploying a new
> job.
> For validating the xmls as well as checking the job is getting the correct
> set of configs, a mock run is needed in a full fledged setup of
> falcon/hadoop/oozie. This I feel is a overkill.
> I propose that we start work on falcon unit which will intialize
> falcon/hadoop/oozie in local mode and run the job locally to test the
> configs and also can be extended to validate input and output datesets.
> This will really help in easily onboarding to falcon jobs as in a matter of
> minutes u can test your process.
> Have created a task on jira:
> https://issues.apache.org/jira/browse/FALCON-1133
> Willing to take this up if the community thinks it will add value.
> Thoughts?
> Thanks
> Karan
View raw message