spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From canan chen <ccn...@gmail.com>
Subject Re: What's the best practice for developing new features for spark ?
Date Wed, 19 Aug 2015 12:10:40 GMT
Thanks Ted.  I notice another thread about running spark programmatically
(client mode for standalone and yarn). Would it be much easier to debug
spark if is is possible ? Hasn't anyone thought about it ?

On Wed, Aug 19, 2015 at 5:50 PM, Ted Yu <yuzhihong@gmail.com> wrote:

> See this thread:
>
>
> http://search-hadoop.com/m/q3RTtdZv0d1btRHl/Spark+build+module&subj=Building+Spark+Building+just+one+module+
>
>
>
> > On Aug 19, 2015, at 1:44 AM, canan chen <ccnfdu@gmail.com> wrote:
> >
> > I want to work on one jira, but it is not easy to do unit test, because
> it involves different components especially UI. spark building is pretty
> slow, I don't want to build it each time to test my code change. I am
> wondering how other people do ? Is there any experience can share ? Thanks
> >
> >
>

Mime
View raw message