spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From kpeng1 <>
Subject Loading in json with spark sql
Date Fri, 13 Mar 2015 23:45:26 GMT
Hi All,

I was noodling around with loading in a json file into spark sql's hive
context and I noticed that I get the following message after loading in the
json file:
PhysicalRDD [_corrupt_record#0], MappedRDD[5] at map at JsonRDD.scala:47

I am using the HiveContext to load in the json file using the jsonFile
command.  I also have 1 json object per line on the file.  Here is a sample
of the contents in the json file:

View this message in context:
Sent from the Apache Spark User List mailing list archive at

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message