spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Flavio Pompermaier <pomperma...@okkam.it>
Subject Re: Schema view of HadoopRDD
Date Fri, 16 May 2014 14:09:37 GMT
Is there any Spark plugin/add-on that facilitate the query to a JSON
content?

Best,
Flavio

On Thu, May 15, 2014 at 6:53 PM, Michael Armbrust <michael@databricks.com>wrote:

> Here is a link with more info:
> http://people.apache.org/~pwendell/catalyst-docs/sql-programming-guide.html
>
>
> On Wed, May 7, 2014 at 10:09 PM, Debasish Das <debasish.das83@gmail.com>wrote:
>
>> Hi,
>>
>> For each line that we read as textLine from HDFS, we have a schema..if
>> there is an API that takes the schema as List[Symbol] and maps each token
>> to the Symbol it will be helpful...
>>
>> Does RDDs provide a schema view of the dataset on HDFS ?
>>
>> Thanks.
>> Deb
>>
>

Mime
View raw message