spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tobias Pfeiffer <...@preferred.jp>
Subject Re: netty on classpath when using spark-submit
Date Mon, 10 Nov 2014 00:48:40 GMT
Hi,

On Wed, Nov 5, 2014 at 10:23 AM, Tobias Pfeiffer wrote:
>
> On Tue, Nov 4, 2014 at 8:33 PM, M. Dale wrote:
>
>>    From http://spark.apache.org/docs/latest/configuration.html it seems
>> that there is an experimental property:
>>
>> spark.files.userClassPathFirst
>>
>
> Thank you very much, I didn't know about this.  Unfortunately, it doesn't
> change anything.  With this setting both true and false (as indicated by
> the Spark web interface) and no matter whether "local[N]" or "yarn-client"
> or "yarn-cluster" mode are used with spark-submit, the classpath looks the
> same and the netty class is loaded from the Spark jar. Can I use this
> setting with spark-submit at all?
>

Has anyone used this setting successfully or can advice me on how to use it
correctly?

Thanks
Tobias

Mime
View raw message