spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Lijun Cao <641507...@qq.com>
Subject Internal Spark class is not registered by Kryo
Date Tue, 09 Oct 2018 11:29:42 GMT
Hi developers:

I have set spark.kryo.registrationRequired=true, but an exception occured: java.lang.IllegalArgumentException:
Class is not registered: org.apache.spark.internal.io.FileCommitProtocol$TaskCommitMessage
when I run the program. 

I tried to register it manually by kryo.register() and Sparkconf.registerKryoClasses, but
it still not work.

The related JIRA is SPARK-21569. And SPARK-10251, SPARK-6497 are may the same problem I think.


Be grateful if someone can help me..

Best Regards,
Lijun Cao
Mime
View raw message