spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From kant kodali <kanth...@gmail.com>
Subject Re: How do I flatten JSON blobs into a Data Frame using Spark/Spark SQL
Date Fri, 18 Nov 2016 10:29:46 GMT
This seem to work

import org.apache.spark.sql._
val rdd = df2.rdd.map { case Row(j: String) => j }
spark.read.json(rdd).show()

However I wonder if this any inefficiency here ? since I have to apply this
function for billion rows.

Mime
View raw message