spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Javier Domingo Cansino <javier.domi...@fon.com>
Subject Re: dse spark-submit multiple jars issue
Date Tue, 11 Aug 2015 10:38:59 GMT
I have no real idea (not java user), but have you tried with the --jars
option?

http://spark.apache.org/docs/latest/submitting-applications.html#advanced-dependency-management

AFAIK, you are currently submitting the jar names as arguments to the
called Class instead of the jars themselves

[image: Fon] <http://www.fon.com/>Javier Domingo CansinoResearch &
Development Engineer+34 946545847Skype: javier.domingo.fonAll information
in this email is confidential <http://corp.fon.com/legal/email-disclaimer>

On Tue, Aug 11, 2015 at 12:29 PM, satish chandra j <jsatishchandra@gmail.com
> wrote:

>
> *HI,*
>
> Please let me know if i am missing anything in the command below
>
> *Command:*
>
> dse spark-submit --master spark://10.246.43.15:7077 --class HelloWorld
> --jars ///home/missingmerch/postgresql-9.4-1201.jdbc41.jar
> ///home/missingmerch/dse.jar
> ///home/missingmerch/spark-cassandra-connector-java_2.10-1.1.1.jar
> ///home/missingmerch/etl-0.0.1-SNAPSHOT.jar
>
>
> *Error:*
>
> *java.lang.ClassNotFoundException: HelloWorld*
>
>         at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
>
>         at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
>
>         at java.security.AccessController.doPrivileged(Native Method)
>
>         at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
>
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
>
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
>
>         at java.lang.Class.forName0(Native Method)
>
>         at java.lang.Class.forName(Class.java:270)
>
>         at
> org.apache.spark.deploy.SparkSubmit$.launch(SparkSubmit.scala:342)
>
>         at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:75)
>
>         at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
>
>
> I understand the way I am giving multiple jar file paths in the command is
> an issue, please provide an appropriate format for providing multiple jars
> in the command
>
>
>
>
> Thanks for support
>
>
> Satish Chandra
>

Mime
View raw message