spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "另一片天" <958943...@qq.com>
Subject 回复: Could not find or load main class org.apache.spark.deploy.yarn.ExecutorLauncher
Date Wed, 22 Jun 2016 06:14:36 GMT
i download offical release version ,not build myself ;
but  i don't config that para ,there no error  ;


------------------ 原始邮件 ------------------
发件人: "Jeff Zhang";<zjffdu@gmail.com>;
发送时间: 2016年6月22日(星期三) 下午2:09
收件人: "Yash Sharma"<yash360@gmail.com>; 
抄送: "另一片天"<958943172@qq.com>; "user"<user@spark.apache.org>; 
主题: Re: Could not find or load main class org.apache.spark.deploy.yarn.ExecutorLauncher



Make sure you built spark with -Pyarn, and check whether you have class ExecutorLauncher in
your spark assembly jar. 



On Wed, Jun 22, 2016 at 2:04 PM, Yash Sharma <yash360@gmail.com> wrote:
How about supplying the jar directly in spark submit - 

./bin/spark-submit \
--class org.apache.spark.examples.SparkPi \
--master yarn-client \
--driver-memory 512m \
--num-executors 2 \
--executor-memory 512m \
--executor-cores 2 \
/user/shihj/spark_lib/spark-examples-1.6.1-hadoop2.6.0.jar


On Wed, Jun 22, 2016 at 3:59 PM, 另一片天 <958943172@qq.com> wrote:
i  config this  para  at spark-defaults.conf
spark.yarn.jar hdfs://master:9000/user/shihj/spark_lib/spark-examples-1.6.1-hadoop2.6.0.jar


then ./bin/spark-submit --class org.apache.spark.examples.SparkPi --master yarn-client --driver-memory
512m --num-executors 2 --executor-memory 512m --executor-cores 2    10:




Error: Could not find or load main class org.apache.spark.deploy.yarn.ExecutorLauncher  

but  i don't config that para ,there no error  why???that para is only avoid Uploading resource
file(jar package)??



 






-- 
Best Regards

Jeff Zhang
Mime
View raw message