spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sandy Ryza <sandy.r...@cloudera.com>
Subject Re: Spark Job submit
Date Wed, 26 Nov 2014 22:58:59 GMT
I think that actually would not work - yarn-cluster mode expects a specific
deployment path that uses SparkSubmit. Setting master as yarn-client should
work.

-Sandy

On Wed, Nov 26, 2014 at 8:32 AM, Akhil Das <akhil@sigmoidanalytics.com>
wrote:

> How about?
>
> - Create a SparkContext
> - setMaster as *yarn-cluster*
> - Create a JavaSparkContext with the above SparkContext
>
> And that will submit it to the yarn cluster.
>
> Thanks
> Best Regards
>
> On Wed, Nov 26, 2014 at 4:20 PM, Naveen Kumar Pokala <
> npokala@spcapitaliq.com> wrote:
>
>> Hi.
>>
>>
>>
>> Is there a way to submit spark job on Hadoop-YARN  cluster from java code.
>>
>>
>>
>> -Naveen
>>
>
>

Mime
View raw message