spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mich Talebzadeh <mich.talebza...@gmail.com>
Subject Re: Does SparkSql has official jdbc/odbc driver?
Date Tue, 29 Mar 2016 08:38:09 GMT
Many vendors like Progress Direct provide JDBC/ODBC drivers for Hive.

As stated before Spark is effectively a query tool not a Data Warehouse
like Hive.

I am curious to know why you want to use Spark SQL on Hive tables whereas
Hive itself provides richer SQL (in other words Spark SQL is a subset of
Hive SQL). It may make more sense to use hive directly via JDBC etc if you
just want to use Spark SQL without Functional programming.

HTH




In general you can use

Dr Mich Talebzadeh



LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
<https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*



http://talebzadehmich.wordpress.com



On 29 March 2016 at 09:27, Sage Meng <lkkey80@gmail.com> wrote:

> Hi,
>
> according to
> https://cwiki.apache.org/confluence/display/Hive/Hive+Transactions#HiveTransactions-NewConfigurationParametersforTransactions
> it seems that insert/delete/update can be supported, but I haven't try it.
>
> 2016-03-29 16:23 GMT+08:00 Jorge Machado <jomach@me.com>:
>
>> Hi,
>>
>> you should know that “Spark” is not a relation database.  So updates on
>> data as you are used to in RDMS are not possible.
>>
>> Jorge Machado
>> www.jmachado.me
>>
>>
>>
>>
>>
>> On 29/03/2016, at 10:21, Sage Meng <lkkey80@gmail.com> wrote:
>>
>> thanks, I found that I can use hive's jdbc driver to connect to spark
>> sql.
>>
>> I am curious whether simba's jdbc/odbc drivers to spark sql can support
>> all standard sql statements, since I haven't tried third-party's jdbc/odbc
>> driver and it seems that hive's jdbc driver can't support
>> insert/delete/update sql well.
>>
>> 2016-03-29 15:47 GMT+08:00 alexpw <alexp@simba.com>:
>>
>>> sage wrote
>>> > Hi all,
>>> >     Does SparkSql has official jdbc/odbc driver? I only saw
>>> third-party's
>>> > jdbc/odbc driver.
>>>
>>> Hi Sage,
>>>
>>> Databricks licenses ODBC driver from Simba Technologies. Here's the link
>>> to
>>> announcement:
>>>
>>> https://databricks.com/blog/2014/04/30/databricks-partners-with-simba-to-deliver-shark-odbc-driver.html
>>>
>>> The driver is available from Databricks website for free:
>>> https://databricks.com/spark/odbc-driver-download but is licensed for
>>> use
>>> only within Databricks Cloud:
>>>
>>> "3. Scope of use: You can use this driver only to connect a third party
>>> application (including Microsoft Excel or Tableau) to Spark SQL within
>>> Databricks Cloud, using the ODBC protocol."
>>>
>>> You can read the Terms of Use here:
>>> https://databricks.wufoo.com/embed/p1xbn36500t2zce/#fo7li1501
>>>
>>> If you plan to use ODBC driver with Spark on any other platform, you can
>>> purchase license from Simba Technologies. Simba also have JDBC driver for
>>> Spark built use the same SQL Engine as the ODBC. Both drivers are
>>> available
>>> for free evaluation and purchase here:
>>> http://www.simba.com/drivers/spark-jdbc-odbc/
>>>
>>> Thanks,
>>>
>>> Alex Popov
>>> Marketing Manager, Simba Technologies Inc.
>>>
>>>
>>>
>>> --
>>> View this message in context:
>>> http://apache-spark-user-list.1001560.n3.nabble.com/Does-SparkSql-has-official-jdbc-odbc-driver-tp26591p26620.html
>>> Sent from the Apache Spark User List mailing list archive at Nabble.com
>>> <http://nabble.com>.
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
>>> For additional commands, e-mail: user-help@spark.apache.org
>>>
>>>
>>
>>
>

Mime
View raw message