spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vipul Pandey <>
Subject Lzo + Protobuf
Date Sat, 18 Jan 2014 00:45:56 GMT
Hi All,

Can someone please share (sample) code to read lzo compressed protobufs from hdfs (using elephant
bird)? I'm trying whatever I see in the forum and on the web but it doesn't seem comprehensive
to me. 

I'm using Spark0.8.0 . My pig scripts are able to read protobuf just fine so the hadoop layer
is setup alright.  It will be really helpful if someone can list out what needs to be done
with/in spark. 


View raw message