spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrew Ash <and...@andrewash.com>
Subject Re: Dying workers since migration to 0.8.1
Date Wed, 08 Jan 2014 18:06:11 GMT
Any exceptions you see in the worker machine's logs would be particularly
useful too.


On Wed, Jan 8, 2014 at 6:00 AM, Prashant Sharma <scrapcodes@gmail.com>wrote:

> Hi,
>
> Can you give a little more details about the problem apart from a few
> hints that would be great !. I would like to exactly what you did and how
> did you end up getting those stuck up executors. This can be due to network
> too. Are you on ec2 ? in that case ec2 n/w is often unpredictable.
>
>
> On Wed, Jan 8, 2014 at 6:58 PM, Guillaume Pitel <
> guillaume.pitel@exensa.com> wrote:
>
>>  Hi,
>>
>> We migrated from 0.8.0 to 0.8.1 on Monday, since then we have observed a
>> high rate of disappearing (they're not in the list anymore) or dying
>> (marked DEAD) workers.
>>
>> This is particularly strange since the processes often continue running.
>>
>> Any idea / advice about this particular problem ?
>>
>> Thanks
>>
>> Guillaume
>> --
>>    [image: eXenSa]
>>  *Guillaume PITEL, Président*
>> +33(0)6 25 48 86 80
>>
>> eXenSa S.A.S. <http://www.exensa.com/>
>>  41, rue Périer - 92120 Montrouge - FRANCE
>> Tel +33(0)1 84 16 36 77 / Fax +33(0)9 72 28 37 05
>>
>
>
>
> --
> Prashant
>

Mime
View raw message