spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael Armbrust <mich...@databricks.com>
Subject Re: loading, querying schemaRDD using SparkSQL
Date Thu, 06 Nov 2014 20:06:18 GMT
It can, but currently that method uses the default hive serde which is not
very robust (does not deal well with \n in strings) and probably is not
super fast.  You'll also need to be using a HiveContext for it to work.

On Tue, Nov 4, 2014 at 8:20 PM, vdiwakar.malladi <vdiwakar.malladi@gmail.com
> wrote:

> Thanks Michael for your response.
>
> Just now, i saw saveAsTable method on JavaSchemaRDD object (in Spark 1.1.0
> API). But I couldn't find the corresponding documentation. Will that help?
> Please let me know.
>
> Thanks in advance.
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/loading-querying-schemaRDD-using-SparkSQL-tp18052p18137.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
>

Mime
View raw message