spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Deepak Sharma <>
Subject Reading back hdfs files saved as case class
Date Fri, 07 Oct 2016 19:20:56 GMT
I am saving RDD[Example] in hdfs from spark program , where Example is case
Now when i am trying to read it back , it returns RDD[String] with the
content as below:

The workaround can be to write as a string in hdfs and read it back as
string and perform further processing.This way the case class name wouldn't
appear at all in the file being written in hdfs.
But i am keen to know if we can read the data directly in Spark if the
RDD[Case_Class] is written to hdfs?


View raw message