spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Wenlei Xie <wenlei....@gmail.com>
Subject Kryo Serializer
Date Sun, 20 Oct 2013 05:24:42 GMT
Hi,

My program cannot use Kyro Serializer after I update to Spark 0.8,
here is the error information

Exception in thread "main" java.lang.InstantiationException:
org.apache.spark.serializer.KryoRegistrator
at java.lang.Class.newInstance(Class.java:359)
at org.apache.spark.serializer.SerializerManager.get(SerializerManager.scala:55)
at org.apache.spark.serializer.SerializerManager.setDefault(SerializerManager.scala:36)
at org.apache.spark.SparkEnv$.createFromSystemProperties(SparkEnv.scala:157)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:105)
at ibm.decaystream.test.LazyDecayTest$.main(LazyDecayTest.scala:35)
at ibm.decaystream.test.LazyDecayTest.main(LazyDecayTest.scala)


Here is how I set up Serializer:

    System.setProperty("spark.serializer",
"org.apache.spark.serializer.KryoRegistrator")
    System.setProperty("spark.kryo.registrator",
classOf[EdgeWithIDRegistrator].getName)

And the exception was thrown out when I try to create the SparkContext.

Is there any suggestions?

Thank you!

Best,
Wenlei

Mime
View raw message