spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nicolas Paris <>
Subject Hive From Spark: Jdbc VS sparkContext
Date Tue, 03 Oct 2017 18:08:48 GMT

I wonder the differences accessing HIVE tables in two different ways:
- with jdbc access
- with sparkContext

I would say that jdbc is better since it uses HIVE that is based on
map-reduce / TEZ and then works on disk. 
Using spark rdd can lead to memory errors on very huge datasets.

Anybody knows or can point me to relevant documentation ?

To unsubscribe e-mail:

View raw message