spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Theodore Wong <...@tmwong.org>
Subject Re: How to pass config variables to workers
Date Sat, 17 May 2014 00:22:58 GMT
Sorry, yes, you are right, the documentation does indeed explain that setting
spark.* options is the way to pass Spark configuration options to workers.
Additionally, we've use the same mechanism to pass application-specific
configuration options to workers; the "hack" part is naming our
application-specific options "spark.myapp.*", which relies on the Spark
library just copying around spark.* options without checking to see whether
the option names are valid Spark options.

Regards,

Theodore



-----
-- 
Theodore Wong &lt;tmw@tmwong.org&gt;
www.tmwong.org

--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/How-to-pass-config-variables-to-workers-tp5780p5916.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

Mime
View raw message