spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Madhu <ma...@madhu.com>
Subject Re: Hadoop Writable and Spark serialization
Date Sat, 17 May 2014 19:48:32 GMT
Have you tried implementing Serializable?

This is similar to what I did:

public class MySequenceFileClass implements WritableComparable, Serializable

Read as sequence file.
I tried takeSample, it works for me.

I found that if I didn't implement Serializable, I got a serialization
exception.

I didn't have to do any registration of the class.
Of course, all referenced classes must also implement Serializable.
Is that a problem in your application?



-----
Madhu
https://www.linkedin.com/in/msiddalingaiah
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Hadoop-Writable-and-Spark-serialization-tp5721p5962.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

Mime
View raw message