spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Yeikel <em...@yeikel.com>
Subject Re: Best Practice for Writing data into a Hive table
Date Sat, 13 Apr 2019 18:40:34 GMT
Writing to CSV is very slow. 

>From what I've seen this is the preferred way to write to hive ; 

myDf.createOrReplaceTempView("mytempTable") 
sqlContext.sql("create table mytable as select * from mytempTable");


Source :
https://stackoverflow.com/questions/30664008/how-to-save-dataframe-directly-to-hive



--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org


Mime
View raw message