spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mayur Rustagi <mayur.rust...@gmail.com>
Subject Streaming files as a whole
Date Thu, 30 Jan 2014 10:08:55 GMT
I am trying to load xml in streaming and convert to csv and store it. When
I use textfile it separates the file on "\n" and hence breaks the parser.
Is it possible to receive the data one file at a time from the hdfs folder ?

Mayur Rustagi
Ph: +919632149971
h <https://twitter.com/mayur_rustagi>ttp://www.sigmoidanalytics.com
https://twitter.com/mayur_rustagi

Mime
View raw message