spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
Subject Re: How to incrementally compile spark examples using mvn
Date Fri, 28 Nov 2014 09:09:51 GMT
Hi,I have a similar problem.I modified the code in mllib and examples.I did mvn install -pl
mllib mvn install -pl examples
But when I run the program in examples using run-example,the older version of  mllib (before
the changes were made) is getting executed.How to get the changes made in mllib while  calling
it from examples project? Thanks & Regards,
Meethu M 

     On Monday, 24 November 2014 3:33 PM, Yiming (John) Zhang <> wrote:

 Thank you, Marcelo and Sean, "mvn install" is a good answer for my demands. 

发件人: Marcelo Vanzin [] 
发送时间: 2014年11月21日 1:47
收件人: yiming zhang
抄送: Sean Owen;
主题: Re: How to incrementally compile spark examples using mvn

Hi Yiming,

On Wed, Nov 19, 2014 at 5:35 PM, Yiming (John) Zhang <> wrote:
> Thank you for your reply. I was wondering whether there is a method of reusing locally-built
components without installing them? That is, if I have successfully built the spark project
as a whole, how should I configure it so that I can incrementally build (only) the "spark-examples"
sub project without the need of downloading or installation?

As Sean suggest, you shouldn't need to install anything. After "mvn install", your local repo
is a working Spark installation, and you can use spark-submit and other tool directly within

You just need to remember to rebuild the assembly/ project when modifying Spark code (or the
examples/ project when modifying examples).


To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message