spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From YaoPau <>
Subject SparkPi endlessly in "yarnAppState: ACCEPTED"
Date Sat, 08 Nov 2014 00:40:40 GMT
I'm using Cloudera 5.1.3, and I'm repeatedly getting the following output
after submitting the SparkPi example in yarn cluster mode

spark-submit --class org.apache.spark.examples.SparkPi --deploy-mode cluster
--master yarn
$SPARK_HOME/examples/lib/spark-examples_2.10-1.0.0-cdh5.1.3.jar 10

Output (repeated):

14/11/07 19:33:05 INFO Client: Application report from ASM: 
	 application identifier: application_1415303569855_1100
	 appId: 1100
	 clientToAMToken: null
	 appMasterHost: N/A
	 appQueue: root.yp
	 appMasterRpcPort: -1
	 appStartTime: 1415406486231
	 yarnAppState: ACCEPTED
	 distributedFinalState: UNDEFINED

I'll note that spark-submit is working correctly when running with "master
local" on the edge node.  

Any ideas how to solve this?

View this message in context:
Sent from the Apache Spark User List mailing list archive at

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message