spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jakub Liska <liska.ja...@gmail.com>
Subject DataFrame support for hadoop glob patterns
Date Wed, 09 Mar 2016 12:38:37 GMT
Hey,

is something like this possible?

sqlContext.read.json("/mnt/views-p/base/2016/01/*/*-xyz.json")

I switched to DataFrames because my source files changed from TSV to JSON
but now I'm not able to load the files as I did before. I get this error if
I try that :

https://github.com/apache/spark/pull/9142#issuecomment-194248531

Mime
View raw message