spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chandeep Singh>
Subject Re: Building Spark packages with SBTor Maven
Date Tue, 15 Mar 2016 10:47:52 GMT
Puled this from stack overflow:

We're using Maven to build Scala projects at work because it integrates well with our CI server.
We could just run a shell script to kick off a build, of course, but we've got a bunch of
other information coming out of Maven that we want to go into CI. That's about the only reason
I can think of to use Maven for a Scala project.

Otherwise, just use SBT. You get access to the same dependencies (really the best part about
maven, IMHO). You also get the incremental compilation, which is huge. The ability to start
up a shell inside of your project, which is also great.

ScalaMock only works with SBT, and you're probably going to want to use that rather than a
Java mocking library. On top of that, it's much easier to extend SBT since you can write full
scala code in the build file, so you don't have to go through all the rigamarole of writing
a Mojo.

In short, just use SBT unless you really need tight integration into your CI server.

> On Mar 15, 2016, at 10:45 AM, Chandeep Singh <> wrote:
> For Scala, SBT is recommended.
>> On Mar 15, 2016, at 10:42 AM, Mich Talebzadeh < <>>
>> Hi,
>> I build my Spark/Scala packages using SBT that works fine. I have created generic
shell scripts to build and submit it.
>> Yesterday I noticed that some use Maven and Pom for this purpose.
>> Which approach is recommended?
>> Thanks,
>> Dr Mich Talebzadeh
>> LinkedIn
>> <>

View raw message