spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jeff Evans <jeffrey.wayne.ev...@gmail.com>
Subject Re: How To Access Hive 2 Through JDBC Using Kerberos
Date Thu, 09 Jul 2020 19:52:14 GMT
There are various sample JDBC URLs documented here, depending on the driver
vendor, Kerberos (or not), and SSL (or not).  Often times, unsurprisingly,
SSL is used in conjunction with Kerberos.  Even if you don't use StreamSets
software at all, you might find these useful.

https://ask.streamsets.com/question/7/how-do-you-configure-a-hive-impala-jdbc-driver-for-data-collector/?answer=8#post-id-8

On Thu, Jul 9, 2020 at 11:28 AM Daniel de Oliveira Mantovani <
daniel.oliveira.mantovani@gmail.com> wrote:

> One of my colleagues found this solution:
>
>
> https://github.com/morfious902002/impala-spark-jdbc-kerberos/blob/master/src/main/java/ImpalaSparkJDBC.java
>
> If you need to connect to Hive or Impala using JDBC with Kerberos
> authentication from Apache Spark, you can use it and will work.
>
> You can download the driver from Cloudera here:
> https://www.cloudera.com/downloads/connectors/hive/jdbc/2-6-1.html
>
>
>
> On Tue, Jul 7, 2020 at 12:03 AM Daniel de Oliveira Mantovani <
> daniel.oliveira.mantovani@gmail.com> wrote:
>
>> Hello Gabor,
>>
>> I meant, third-party connector* not "connection".
>>
>> Thank you so much!
>>
>> On Mon, Jul 6, 2020 at 1:09 PM Gabor Somogyi <gabor.g.somogyi@gmail.com>
>> wrote:
>>
>>> Hi Daniel,
>>>
>>> I'm just working on the developer API where any custom JDBC connection
>>> provider(including Hive) can be added.
>>> Not sure what you mean by third-party connection but AFAIK there is no
>>> workaround at the moment.
>>>
>>> BR,
>>> G
>>>
>>>
>>> On Mon, Jul 6, 2020 at 12:09 PM Daniel de Oliveira Mantovani <
>>> daniel.oliveira.mantovani@gmail.com> wrote:
>>>
>>>> Hello List,
>>>>
>>>> Is it possible to access Hive 2 through JDBC with Kerberos
>>>> authentication from Apache Spark JDBC interface ? If it's possible do you
>>>> have an example ?
>>>>
>>>> I found this tickets on JIRA:
>>>> https://issues.apache.org/jira/browse/SPARK-12312
>>>> https://issues.apache.org/jira/browse/SPARK-31815
>>>>
>>>> Do you know if there's a workaround for this ? Maybe using a
>>>> third-party connection ?
>>>>
>>>> Thank you so much
>>>> --
>>>>
>>>> --
>>>> Daniel Mantovani
>>>>
>>>>
>>
>> --
>>
>> --
>> Daniel Mantovani
>>
>>
>
> --
>
> --
> Daniel Mantovani
>
>

Mime
View raw message