spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From أنس الليثي <dev.fano...@gmail.com>
Subject Re: Connecting a PHP/Java applications to Spark SQL Thrift Server
Date Wed, 04 Mar 2015 09:00:58 GMT
Thanks very much, I used it and works fine with me.



On 4 March 2015 at 11:56, Arush Kharbanda <arush@sigmoidanalytics.com>
wrote:

> For java You can use hive-jdbc connectivity jars to connect to Spark-SQL.
>
> The driver is inside the hive-jdbc Jar.
>
> *http://hive.apache.org/javadocs/r0.11.0/api/org/apache/hadoop/hive/jdbc/HiveDriver.html
> <http://hive.apache.org/javadocs/r0.11.0/api/org/apache/hadoop/hive/jdbc/HiveDriver.html>*
>
>
>
>
> On Wed, Mar 4, 2015 at 1:26 PM, <nate@reactor8.com> wrote:
>
>> SparkSQL supports JDBC/ODBC connectivity, so if that's the route you
>> needed/wanted to connect through you could do so via java/php apps.
>> Havent
>> used either so cant speak to the developer experience, assume its pretty
>> good as would be preferred method for lots of third party enterprise
>> apps/tooling
>>
>> If you prefer using the thrift server/interface, if they don't exist
>> already
>> in open source land you can use thrift definitions to generate client libs
>> in any supported thrift language and use that for connectivity.  Seems one
>> issue with thrift-server is when running in cluster mode.  Seems like it
>> still exists but UX of error has been cleaned up in 1.3:
>>
>> https://issues.apache.org/jira/browse/SPARK-5176
>>
>>
>>
>> -----Original Message-----
>> From: fanooos [mailto:dev.fanooos@gmail.com]
>> Sent: Tuesday, March 3, 2015 11:15 PM
>> To: user@spark.apache.org
>> Subject: Connecting a PHP/Java applications to Spark SQL Thrift Server
>>
>> We have installed hadoop cluster with hive and spark and the spark sql
>> thrift server is up and running without any problem.
>>
>> Now we have set of applications need to use spark sql thrift server to
>> query
>> some data.
>>
>> Some of these applications are java applications and the others are PHP
>> applications.
>>
>> As I am an old fashioned java developer, I used to connect java
>> applications
>> to BD servers like Mysql using a JDBC driver. Is there a corresponding
>> driver for connecting with Spark Sql Thrift server ? Or what is the
>> library
>> I need to use to connect to it?
>>
>>
>> For PHP, what are the ways we can use to connect PHP applications to Spark
>> Sql Thrift Server?
>>
>>
>>
>>
>>
>> --
>> View this message in context:
>>
>> http://apache-spark-user-list.1001560.n3.nabble.com/Connecting-a-PHP-Java-ap
>> plications-to-Spark-SQL-Thrift-Server-tp21902.html
>> <http://apache-spark-user-list.1001560.n3.nabble.com/Connecting-a-PHP-Java-applications-to-Spark-SQL-Thrift-Server-tp21902.html>
>> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org For additional
>> commands, e-mail: user-help@spark.apache.org
>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
>> For additional commands, e-mail: user-help@spark.apache.org
>>
>>
>
>
> --
>
> [image: Sigmoid Analytics] <http://htmlsig.com/www.sigmoidanalytics.com>
>
> *Arush Kharbanda* || Technical Teamlead
>
> arush@sigmoidanalytics.com || www.sigmoidanalytics.com
>



-- 
Anas Rabei
Senior Software Developer
Mubasher.info
anas.rabei@mubasher.info

Mime
View raw message