Try to use spark-shell --conf spark.akka.frameSize=10000

在 2014年12月1日,上午12:25,Brian Dolan <buddha_314@yahoo.com.INVALID> 写道:

Howdy Folks,

What is the correct syntax in 1.0.0 to set networking variables in spark shell?  Specifically, I'd like to set the spark.akka.frameSize

I'm attempting this:
spark-shell -Dspark.akka.frameSize=10000 --executor-memory 4g

Only to get this within the session:

System.getProperty("spark.executor.memory")
res0: String = 4g
System.getProperty("spark.akka.frameSize")
res1: String = null

I don't believe I am violating protocol, but I have also posted this to SO: http://stackoverflow.com/questions/27215288/how-do-i-set-spark-akka-framesize-in-spark-shell

~~~~~~
May All Your Sequences Converge