spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sea" <261810...@qq.com>
Subject 回复: Spark-sql(yarn-client) java.lang.NoClassDefFoundError: org/apache/spark/deploy/yarn/ExecutorLauncher
Date Fri, 19 Jun 2015 03:05:05 GMT
Thanks, Yin Huai
I work it out.
I use JDK1.7 to build Spark 1.4.0, but my yarn cluster run on JDK1.6. 
But java.version in pom.xml in 1.6 and the exception makes me confused




------------------ 原始邮件 ------------------
发件人: "Yin Huai";<yhuai@databricks.com>;
发送时间: 2015年6月18日(星期四) 晚上11:19
收件人: "Sea"<261810726@qq.com>; 
抄送: "dev"<dev@spark.apache.org>; 
主题: Re: Spark-sql(yarn-client) java.lang.NoClassDefFoundError: org/apache/spark/deploy/yarn/ExecutorLauncher



Is it the full stack trace?

On Thu, Jun 18, 2015 at 6:39 AM, Sea <261810726@qq.com> wrote:
Hi, all:


I want to run spark sql on yarn(yarn-client), but ... I already set "spark.yarn.jar" and 
"spark.jars" in conf/spark-defaults.conf.
./bin/spark-sql -f game.sql --executor-memory 2g --num-executors 100 > game.txt
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/spark/deploy/yarn/ExecutorLauncher
Caused by: java.lang.ClassNotFoundException: org.apache.spark.deploy.yarn.ExecutorLauncher
        at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
Could not find the main class: org.apache.spark.deploy.yarn.ExecutorLauncher.  Program will
exit.







Anyone can help?
Mime
View raw message