spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "BOT" <641507...@qq.com>
Subject Internal Spark class is not registered by Kryo
Date Tue, 09 Oct 2018 11:47:07 GMT
Hi developers:
I have set spark.kryo.registrationRequired=true, but an exception occured: java.lang.IllegalArgumentException:
Class is not registered: org.apache.spark.internal.io.FileCommitProtocol$TaskCommitMessage
when I run the program. 
I tried to register it manually by kryo.register() and Sparkconf.registerKryoClasses, but
it still not work.
The related JIRA is SPARK-21569. And SPARK-10251, SPARK-6497 are may the same problem I think.

Be grateful if someone can help me..


Best Regards,
Lijun Cao
Mime
View raw message