spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jem Tucker <jem.tuc...@gmail.com>
Subject Re: Spark on YARN
Date Sat, 08 Aug 2015 08:37:25 GMT
Hi Sandy,

The application doesn't fail, it gets accepted by yarn but the application
master never starts and the application state never changes to running. I
have checked in the resource manager and node manager logs and nothing
jumps out.

Thanks

Jem
On Sat, 8 Aug 2015 at 09:20, Sandy Ryza <sandy.ryza@cloudera.com> wrote:

> Hi Jem,
>
> Do they fail with any particular exception?  Does YARN just never end up
> giving them resources?  Does an application master start?  If so, what are
> in its logs?  If not, anything suspicious in the YARN ResourceManager logs?
>
> -Sandy
>
> On Fri, Aug 7, 2015 at 1:48 AM, Jem Tucker <jem.tucker@gmail.com> wrote:
>
>> Hi,
>>
>> I am running spark on YARN on the CDH5.3.2 stack. I have created a new
>> user to own and run a testing environment, however when using this user
>> applications I submit to yarn never begin to run, even if they are the
>> exact same application that is successful with another user?
>>
>> Has anyone seen anything like this before?
>>
>> Thanks,
>>
>> Jem
>>
>
>

Mime
View raw message