spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Robin Cjc <cjcro...@gmail.com>
Subject Re: SPARK_JAVA_OPTS not picked up by the application
Date Tue, 11 Mar 2014 04:06:57 GMT
The properties in spark-env.sh are machine-specific. so need to specify in
you worker as well. I guess you ask is the System.setproperty(). you can
call it before you initialize your sparkcontext.

Best Regards,
Chen Jingci


On Tue, Mar 11, 2014 at 6:47 AM, Linlin <linlin200605@gmail.com> wrote:

>
> Hi,
>
> I have a java option (-Xss) setting specified in SPARK_JAVA_OPTS in
> spark-env.sh,  noticed after stop/restart the spark cluster, the
> master/worker daemon has the setting being applied, but this setting is not
> being propagated to the executor, my application continue behave the same.
> I
> am not sure if there is a way to specify it through SparkConf? like
> SparkConf.set(), and what is the correct way of setting this up for a
> particular spark application.
>
> Thank you!
>
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/SPARK-JAVA-OPTS-not-picked-up-by-the-application-tp2483.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>

Mime
View raw message