spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Juan Rodríguez Hortalá <juan.rodriguez.hort...@gmail.com>
Subject Re: Debugging "Task not serializable"
Date Wed, 30 Jul 2014 08:43:30 GMT
Akhil, Andry, thanks a lot for your suggestions. I will take a look to
those JVM options.

Greetings,

Juan


2014-07-28 18:56 GMT+02:00 andy petrella <andy.petrella@gmail.com>:

> Also check the guides for the JVM option that prints messages for such
> problems.
> Sorry, sent from phone and don't know it by heart :/
> Le 28 juil. 2014 18:44, "Akhil Das" <akhil@sigmoidanalytics.com> a écrit :
>
> A quick fix would be to implement java.io.Serializable in those classes
>> which are causing this exception.
>>
>>
>>
>> Thanks
>> Best Regards
>>
>>
>> On Mon, Jul 28, 2014 at 9:21 PM, Juan Rodríguez Hortalá <
>> juan.rodriguez.hortala@gmail.com> wrote:
>>
>>> Hi all,
>>>
>>> I was wondering if someone has conceived a method for debugging "Task
>>> not serializable: java.io.NotSerializableException" errors, apart from
>>> commenting and uncommenting parts of the program, or just turning
>>> everything into Serializable. I find this kind of error very hard to debug,
>>> as these are originated in the Spark runtime system.
>>>
>>> I'm using Spark for Java.
>>>
>>> Thanks a lot in advance,
>>>
>>> Juan
>>>
>>
>>

Mime
View raw message