spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From 曹礼俊 <caolijun1...@gmail.com>
Subject Internal Spark class is not registered by Kryo
Date Tue, 09 Oct 2018 15:00:40 GMT
Hi all:

I have set spark.kryo.registrationRequired=true, but an exception occured:
java.lang.IllegalArgumentException: Class is not registered:
org.apache.spark.internal.io.FileCommitProtocol$TaskCommitMessage when I
run the program.

I tried to register it manually by kryo.register() and
Sparkconf.registerKryoClasses, but it still not work.

The related JIRA is SPARK-21569. And SPARK-10251, SPARK-6497 are may the
same problem I think.

Be grateful if someone can help me..

Best Regards,
Lijun Cao

Mime
View raw message