spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Amit Sela (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SPARK-15489) Dataset kryo encoder fails on Collections$UnmodifiableCollection
Date Mon, 23 May 2016 19:41:12 GMT
Amit Sela created SPARK-15489:
---------------------------------

             Summary: Dataset kryo encoder fails on Collections$UnmodifiableCollection
                 Key: SPARK-15489
                 URL: https://issues.apache.org/jira/browse/SPARK-15489
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 1.6.1
            Reporter: Amit Sela


When using Encoders with kryo to encode generically typed Objects in the following manner:

public static <T> Encoder<T> encoder() {
  return Encoders.kryo((Class<T>) Object.class);
}

I get a decoding exception when trying to decode `java.util.Collections$UnmodifiableCollection`,
which probably comes from Guava's `ImmutableList`.

This happens when running with master = local[1]. Same code had no problems with RDD api.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message