spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From deric <barton.to...@gmail.com>
Subject Spark executor paths
Date Fri, 21 Mar 2014 17:05:28 GMT
I'm trying to run Spark on Mesos and I'm getting this error:

java.lang.ClassNotFoundException: org/apache/spark/serializer/JavaSerializer
        at java.lang.Class.forName0(Native Method)
        at java.lang.Class.forName(Class.java:270)
        at org.apache.spark.SparkEnv$.instantiateClass$1(SparkEnv.scala:151)
        at org.apache.spark.SparkEnv$.create(SparkEnv.scala:162)
        at org.apache.spark.executor.Executor.<init>(Executor.scala:105)
        at
org.apache.spark.executor.MesosExecutorBackend.registered(MesosExecutorBackend.scala:56)
Exception in thread "Thread-0"


the Spark command is following:

 java -cp
/usr/share/spark/examples/target/scala-2.10/spark-examples-assembly-1.0.0-SNAPSHOT.jar::/usr/share/spark/conf:/usr/share/spark/jars/spark-assembly-1.0.0-SNAPSHOT-hadoop1.0.4.jar
-Djava.library.path=/usr/share/spark/jars/spark-assembly-1.0.0-SNAPSHOT-hadoop1.0.4.jar
org.apache.spark.examples.SparkPi zk://zookeeper:2181/mesos

There might be a problem with jar path on executors, is there a way how to
debug this?

Thanks,
Tomas




--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-executor-paths-tp3003.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

Mime
View raw message