spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nicolas Paris <nipari...@gmail.com>
Subject Hive From Spark: Jdbc VS sparkContext
Date Tue, 03 Oct 2017 18:08:48 GMT
Hi

I wonder the differences accessing HIVE tables in two different ways:
- with jdbc access
- with sparkContext

I would say that jdbc is better since it uses HIVE that is based on
map-reduce / TEZ and then works on disk. 
Using spark rdd can lead to memory errors on very huge datasets.


Anybody knows or can point me to relevant documentation ?

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org


Mime
View raw message