spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Alan Braithwaite <a...@cloudflare.com>
Subject Re: Spark-submit fails when jar is in HDFS
Date Sun, 09 Aug 2015 16:14:52 GMT
>
> Did you try this way?



/usr/local/spark/bin/spark-submit --master mesos://mesos.master:5050 --conf
> spark.mesos.executor.docker.image=docker.repo/spark:latest --class
> org.apache.spark.examples.SparkPi --jars
> hdfs://hdfs1/tmp/spark-examples-1.4.1-hadoop2.6.0-cdh5.4.4.jar 100


I did, and got the same error (I verified again right now too).

Also, Spark on Mesos supports cluster mode:
> http://spark.apache.org/docs/latest/running-on-mesos.html#cluster-mode


Oh cool!  Looks like this page needs to be updated then:

http://spark.apache.org/docs/latest/submitting-applications.html

Thanks!
- Alan

Mime
View raw message