spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrew Lee <alee...@hotmail.com>
Subject Is spark 1.0.0 "spark-shell --master=yarn" running in yarn-cluster mode or yarn-client mode?
Date Wed, 21 May 2014 17:57:52 GMT
Does anyone know if:
./bin/spark-shell --master yarn 
is running yarn-cluster or yarn-client by default?
Base on source code:







./core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala
    if (args.deployMode == "cluster" && args.master.startsWith("yarn")) {      args.master
= "yarn-cluster"    }    if (args.deployMode != "cluster" && args.master.startsWith("yarn"))
{      args.master = "yarn-client"












    }
It looks like the answer is yarn-cluster mode.
I want to confirm this with the community, thanks. 		 	   		  
Mime
View raw message