spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Eugen Cepoi <>
Subject Re: Packaging a spark job using maven
Date Fri, 16 May 2014 08:42:48 GMT
Laurent the problem is that the reference.conf that is embedded in akka
jars is being overriden by some other conf. This happens when multiple
files have the same name.
I am using Spark with maven. In order to build the fat jar I use the shade
plugin and it works pretty well. The trick here is to use an
AppendingTransformer that will merge all the resource.conf into a single

Try something like that:


                                    <!-- Include here the dependencies you
want to be packed in your fat jar -->

2014-05-14 15:37 GMT+02:00 Laurent T <>:

> Hi,
> Thanks Fran├žois but this didn't change much. I'm not even sure what this
> reference.conf is. It isn't mentioned in any of spark documentation. Should
> i have one in my resources ?
> Thanks
> Laurent
> --
> View this message in context:
> Sent from the Apache Spark User List mailing list archive at

View raw message