spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Javier Domingo Cansino <javier.domi...@fon.com>
Subject Re: dse spark-submit multiple jars issue
Date Tue, 11 Aug 2015 12:45:53 GMT
use --verbose, it might give you some insights on what0s happening,....

[image: Fon] <http://www.fon.com/>Javier Domingo CansinoResearch &
Development Engineer+34 946545847Skype: javier.domingo.fonAll information
in this email is confidential <http://corp.fon.com/legal/email-disclaimer>

On Tue, Aug 11, 2015 at 2:44 PM, satish chandra j <jsatishchandra@gmail.com>
wrote:

> HI ,
> I have used --jars option as well, please find the command below
>
> *Command:*
>
> dse spark-submit --master spark://10.246.43.15:7077 --class HelloWorld
> *--jars* ///home/missingmerch/postgresql-9.4-1201.jdbc41.jar
> ///home/missingmerch/dse.jar
> ///home/missingmerch/spark-cassandra-connector-java_2.10-1.1.1.jar
> ///home/missingmerch/etl-0.0.1-SNAPSHOT.jar
>
> Regards,
> Satish
>
> On Tue, Aug 11, 2015 at 4:08 PM, Javier Domingo Cansino <
> javier.domingo@fon.com> wrote:
>
>> I have no real idea (not java user), but have you tried with the --jars
>> option?
>>
>>
>> http://spark.apache.org/docs/latest/submitting-applications.html#advanced-dependency-management
>>
>> AFAIK, you are currently submitting the jar names as arguments to the
>> called Class instead of the jars themselves
>>
>> [image: Fon] <http://www.fon.com/>Javier Domingo CansinoResearch &
>> Development Engineer+34 946545847Skype: javier.domingo.fonAll
>> information in this email is confidential
>> <http://corp.fon.com/legal/email-disclaimer>
>>
>> On Tue, Aug 11, 2015 at 12:29 PM, satish chandra j <
>> jsatishchandra@gmail.com> wrote:
>>
>>>
>>> *HI,*
>>>
>>> Please let me know if i am missing anything in the command below
>>>
>>> *Command:*
>>>
>>> dse spark-submit --master spark://10.246.43.15:7077 --class HelloWorld
>>> --jars ///home/missingmerch/postgresql-9.4-1201.jdbc41.jar
>>> ///home/missingmerch/dse.jar
>>> ///home/missingmerch/spark-cassandra-connector-java_2.10-1.1.1.jar
>>> ///home/missingmerch/etl-0.0.1-SNAPSHOT.jar
>>>
>>>
>>> *Error:*
>>>
>>> *java.lang.ClassNotFoundException: HelloWorld*
>>>
>>>         at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
>>>
>>>         at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
>>>
>>>         at java.security.AccessController.doPrivileged(Native Method)
>>>
>>>         at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
>>>
>>>         at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
>>>
>>>         at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
>>>
>>>         at java.lang.Class.forName0(Native Method)
>>>
>>>         at java.lang.Class.forName(Class.java:270)
>>>
>>>         at
>>> org.apache.spark.deploy.SparkSubmit$.launch(SparkSubmit.scala:342)
>>>
>>>         at
>>> org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:75)
>>>
>>>         at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
>>>
>>>
>>> I understand the way I am giving multiple jar file paths in the command
>>> is an issue, please provide an appropriate format for providing multiple
>>> jars in the command
>>>
>>>
>>>
>>>
>>> Thanks for support
>>>
>>>
>>> Satish Chandra
>>>
>>
>>
>

Mime
View raw message