spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrea Esposito <and1...@gmail.com>
Subject Re: KryoSerializer Exception
Date Sat, 10 May 2014 10:32:41 GMT
UP, doesn't anyone know something about it? ^^


2014-05-06 12:05 GMT+02:00 Andrea Esposito <and1989@gmail.com>:

> Hi there,
>
> sorry if i'm posting a lot lately.
>
> i'm trying to add the KryoSerializer but i receive this exception:
> 2014 - 05 - 06 11: 45: 23 WARN TaskSetManager: 62 - Loss was due to
> java.io.EOFException
> java.io.EOFException
> at
> org.apache.spark.serializer.KryoDeserializationStream.readObject(KryoSerializer.scala:
> 105)
> at org.apache.spark.broadcast.HttpBroadcast$.read(HttpBroadcast.scala: 165)
> at
> org.apache.spark.broadcast.HttpBroadcast.readObject(HttpBroadcast.scala: 56)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:
> 57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:
> 43)
> at java.lang.reflect.Method.invoke(Method.java: 606)
>
> I set the serializer as:
> System.setProperty("spark.serializer",
> "org.apache.spark.serializer.KryoSerializer")
> System.setProperty("spark.kryo.registrator", "test.TestKryoRegistrator")
>
> With or without register my custom registrator it throws the exception.
>
> Seems something related to broadcast.. but isn't Kryo already ok out of
> the box just setting it as default serializer?
>

Mime
View raw message