The properties in are machine-specific. so need to specify in you worker as well. I guess you ask is the System.setproperty(). you can call it before you initialize your sparkcontext.

Best Regards,
Chen Jingci

On Tue, Mar 11, 2014 at 6:47 AM, Linlin <> wrote:


I have a java option (-Xss) setting specified in SPARK_JAVA_OPTS in,  noticed after stop/restart the spark cluster, the
master/worker daemon has the setting being applied, but this setting is not
being propagated to the executor, my application continue behave the same. I
am not sure if there is a way to specify it through SparkConf? like
SparkConf.set(), and what is the correct way of setting this up for a
particular spark application.

Thank you!

View this message in context:
Sent from the Apache Spark User List mailing list archive at