spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Marcelo Vanzin <van...@cloudera.com>
Subject Re: ClassLoader resources on executor
Date Wed, 02 Dec 2015 18:35:51 GMT
On Tue, Dec 1, 2015 at 12:45 PM, Charles Allen
<charles.allen@metamarkets.com> wrote:
> Is there a way to pass configuration file resources to be resolvable through
> the classloader?

Not in general. If you're using YARN, you can cheat and use
"spark.yarn.dist.files" which will place those files in the classpath;
the same for "--files" in yarn cluster mode (but *not* client mode!).

-- 
Marcelo

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org


Mime
View raw message