spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From patcharee <Patcharee.Thong...@uni.no>
Subject Re: insert Hive table with RDD
Date Wed, 04 Mar 2015 11:03:52 GMT
Hi,

I guess that toDF() api in spark 1.3 which is required build from source 
code?

Patcharee

On 03. mars 2015 13:42, Cheng, Hao wrote:
> Using the SchemaRDD / DataFrame API via HiveContext
>
> Assume you're using the latest code, something probably like:
>
> val hc = new HiveContext(sc)
> import hc.implicits._
> existedRdd.toDF().insertInto("hivetable")
> or
>
> existedRdd.toDF().registerTempTable("mydata")
> hc.sql("insert into hivetable as select xxx from mydata")
>
>
>
> -----Original Message-----
> From: patcharee [mailto:Patcharee.Thongtra@uni.no]
> Sent: Tuesday, March 3, 2015 7:09 PM
> To: user@spark.apache.org
> Subject: insert Hive table with RDD
>
> Hi,
>
> How can I insert an existing hive table with an RDD containing my data?
> Any examples?
>
> Best,
> Patcharee
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org For additional commands, e-mail:
user-help@spark.apache.org
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>


---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org


Mime
View raw message