spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Efe Selcuk <efema...@gmail.com>
Subject Re: Spark2 SBT Assembly
Date Wed, 10 Aug 2016 17:50:56 GMT
Sorry, I should have specified that I'm specifically looking for that fat
assembly behavior. Is it no longer possible?

On Wed, Aug 10, 2016 at 10:46 AM, Nick Pentreath <nick.pentreath@gmail.com>
wrote:

> You're correct - Spark packaging has been shifted to not use the assembly
> jar.
>
> To build now use "build/sbt package"
>
>
>
> On Wed, 10 Aug 2016 at 19:40, Efe Selcuk <efeman92@gmail.com> wrote:
>
>> Hi Spark folks,
>>
>> With Spark 1.6 the 'assembly' target for sbt would build a fat jar with
>> all of the main Spark dependencies for building an application. Against
>> Spark 2, that target is no longer building a spark assembly, just ones for
>> e.g. Flume and Kafka.
>>
>> I'm not well versed with maven and sbt, so I don't know how to go about
>> figuring this out.
>>
>> Is this intended? Or am I missing something?
>>
>> Thanks.
>>
>

Mime
View raw message