spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rishi Mishra <>
Subject Re: ClassLoader resources on executor
Date Wed, 02 Dec 2015 08:53:20 GMT
Did you try to use *spark.executor.extraClassPath*. The classpath resources
will be accessible through the executors class loader which executes your

On Wed, Dec 2, 2015 at 2:15 AM, Charles Allen <
> wrote:

> Is there a way to pass configuration file resources to be resolvable
> through the classloader?
> For example, if I'm using a library (non-spark) that can use a
> file in the classpath/classLoader, can I pass that file
> so that when it tries to get the resource from the classloader it is able
> to find it?
> One potential solution is to take the files and package them as resources
> in a jar, and include the jar as part of the spark job, but that feels like
> a hack instead of an actual solution.
> Is there any support or planned support for such a thing?
> seems to tackle a similar
> problem in a hard-coded kind of way.
> Thank you,
> Charles Allen

Rishitesh Mishra,
SnappyData . (

View raw message