spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From didi <>
Subject spark-submit to remote master fails
Date Wed, 23 Jul 2014 17:40:49 GMT
Hi all
I guess the problem has something to do with the fact i submit the job to
remote location 

I submit from OracleVM running ubuntu and suspect some NAT issues maybe?
akka tcp tries this address as follows from the STDERR print which is
appended akka.tcp://spark@LinuxDevVM.local:59266


Spark Executor Command: "java" "-cp"
"-XX:MaxPermSize=128m" "-Xms1024M" "-Xmx1024M"
"akka.tcp://spark@LinuxDevVM.local:59266/user/CoarseGrainedScheduler" "3"
"" "4"

log4j:WARN No appenders could be found for logger
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See for
more info.
14/07/23 13:27:04 INFO SparkHadoopUtil: Using Spark's default log4j profile:
14/07/23 13:27:04 INFO SecurityManager: Changing view acls to: root
14/07/23 13:27:04 INFO SecurityManager: SecurityManager: authentication
disabled; ui acls disabled; users with view permissions: Set(root)
14/07/23 13:27:05 INFO Slf4jLogger: Slf4jLogger started
14/07/23 13:27:05 INFO Remoting: Starting remoting
14/07/23 13:27:05 INFO Remoting: Remoting started; listening on addresses
14/07/23 13:27:05 INFO Remoting: Remoting now listens on addresses:
14/07/23 13:27:05 INFO CoarseGrainedExecutorBackend: Connecting to driver:
14/07/23 13:27:05 INFO WorkerWatcher: Connecting to worker
14/07/23 13:27:05 WARN Remoting: Tried to associate with unreachable remote
address [akka.tcp://spark@LinuxDevVM.local:59266]. Address is now gated for
60000 ms, all messages to this address will be delivered to dead letters.
14/07/23 13:27:05 ERROR CoarseGrainedExecutorBackend: Driver Disassociated
[akka.tcp://] ->
[akka.tcp://spark@LinuxDevVM.local:59266] disassociated! Shutting down.

View this message in context:
Sent from the Apache Spark User List mailing list archive at

View raw message