spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrea Esposito <and1...@gmail.com>
Subject Increase Stack Size Workers
Date Mon, 05 May 2014 21:20:55 GMT
Hi there,

i'm doing an iterative algorithm and sometimes i ended up with
StackOverflowError, doesn't matter if i do checkpoints or not.

Remaining i don't understand why this is happening, i figure out that
increasing the stack size is a workaround.

Developing using "local[n]" so the local mode i can set the stack size
through the -Xss parameter. How can i do the same for the standalone mode
for each worker? Setting it as "java -Xss16m Worker" seems useless because
the actual computation are done on CoarseGrainExecutor..

Best,
EA

Mime
View raw message