spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Saisai Shao <sai.sai.s...@gmail.com>
Subject Re: Submitting with --deploy-mode cluster: uploading the jar
Date Wed, 30 Sep 2015 07:19:26 GMT
As I remembered you don't need to upload application jar manually, Spark
will do it for you when you use Spark submit. Would you mind posting out
your command of Spark submit?


On Wed, Sep 30, 2015 at 3:13 PM, Christophe Schmitz <cofcof.oz@gmail.com>
wrote:

> Hi there,
>
> I am trying to use the "--deploy-mode cluster" option to submit my job
> (spark 1.4.1). When I do that, the spark-driver (on the cluster) is looking
> for my application jar. I can manually copy my application jar on all the
> workers, but I was wondering if there is a way to submit the application
> jar when running spark-submit.
>
> Thanks!
>

Mime
View raw message