spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Amey Chaugule <ambr...@gmail.com>
Subject Re: hadoop_conf_dir when running spark on yarn
Date Tue, 04 Nov 2014 06:41:40 GMT
I'm using org.apache.spark.deploy.yarn.Client object to run my spark job. I
guess this is what spark-submit wraps really.

- Amey

On Mon, Nov 3, 2014 at 5:25 PM, Tobias Pfeiffer <tgp@preferred.jp> wrote:

> Hi,
>
> On Mon, Nov 3, 2014 at 1:29 PM, Amey Chaugule <ambrood@gmail.com> wrote:
>
>> I thought that only applied when you're trying to run a job using
>> spark-submit or in the shell...
>>
>
> And how are you starting your Yarn job, if not via spark-submit?
>
> Tobias
>
>


-- 
Amey S. Chaugule

B.S Computer Engineering and Mathematics '11,
University of Illinois at Urbana-Champaign

Mime
View raw message