spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ritesh Kumar Singh <riteshoneinamill...@gmail.com>
Subject Re: Setting network variables in spark-shell
Date Sun, 30 Nov 2014 16:36:08 GMT
Spark configuration settings can be found here
<http://spark.apache.org/docs/latest/configuration.html>

Hope it helps :)

On Sun, Nov 30, 2014 at 9:55 PM, Brian Dolan <buddha_314@yahoo.com.invalid>
wrote:

> Howdy Folks,
>
> What is the correct syntax in 1.0.0 to set networking variables in spark
> shell?  Specifically, I'd like to set the spark.akka.frameSize
>
> I'm attempting this:
>
> spark-shell -Dspark.akka.frameSize=10000 --executor-memory 4g
>
>
> Only to get this within the session:
>
> System.getProperty("spark.executor.memory")
> res0: String = 4g
> System.getProperty("spark.akka.frameSize")
> res1: String = null
>
>
> I don't believe I am violating protocol, but I have also posted this to
> SO:
> http://stackoverflow.com/questions/27215288/how-do-i-set-spark-akka-framesize-in-spark-shell
>
> ~~~~~~
> May All Your Sequences Converge
>
>
>
>

Mime
View raw message