spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gourav Sengupta <gourav.sengu...@gmail.com>
Subject Re: Hive From Spark: Jdbc VS sparkContext
Date Tue, 10 Oct 2017 21:35:46 GMT
Hi,

I do not think that SPARK will automatically determine the partitions.
Actually it does not automatically determine the partitions. In case a
table has a few million records, it all goes through the driver.


Ofcourse, I have only tried JDBC connections in AURORA, Oracle and Postgres.

Regards,
Gourav Sengupta

On Tue, Oct 10, 2017 at 10:14 PM, weand <andreas.weise@gmail.com> wrote:

> Is Hive from Spark via JDBC working for you? In case it does, I would be
> interested in your setup :-)
>
> We can't get this working. See bug here, especially my last comment:
> https://issues.apache.org/jira/browse/SPARK-21063
>
> Regards
> Andreas
>
>
>
> --
> Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: user-unsubscribe@spark.apache.org
>
>

Mime
View raw message