spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Arush Kharbanda <ar...@sigmoidanalytics.com>
Subject Re: Connecting a PHP/Java applications to Spark SQL Thrift Server
Date Wed, 04 Mar 2015 08:56:57 GMT
For java You can use hive-jdbc connectivity jars to connect to Spark-SQL.

The driver is inside the hive-jdbc Jar.

*http://hive.apache.org/javadocs/r0.11.0/api/org/apache/hadoop/hive/jdbc/HiveDriver.html
<http://hive.apache.org/javadocs/r0.11.0/api/org/apache/hadoop/hive/jdbc/HiveDriver.html>*




On Wed, Mar 4, 2015 at 1:26 PM, <nate@reactor8.com> wrote:

> SparkSQL supports JDBC/ODBC connectivity, so if that's the route you
> needed/wanted to connect through you could do so via java/php apps.  Havent
> used either so cant speak to the developer experience, assume its pretty
> good as would be preferred method for lots of third party enterprise
> apps/tooling
>
> If you prefer using the thrift server/interface, if they don't exist
> already
> in open source land you can use thrift definitions to generate client libs
> in any supported thrift language and use that for connectivity.  Seems one
> issue with thrift-server is when running in cluster mode.  Seems like it
> still exists but UX of error has been cleaned up in 1.3:
>
> https://issues.apache.org/jira/browse/SPARK-5176
>
>
>
> -----Original Message-----
> From: fanooos [mailto:dev.fanooos@gmail.com]
> Sent: Tuesday, March 3, 2015 11:15 PM
> To: user@spark.apache.org
> Subject: Connecting a PHP/Java applications to Spark SQL Thrift Server
>
> We have installed hadoop cluster with hive and spark and the spark sql
> thrift server is up and running without any problem.
>
> Now we have set of applications need to use spark sql thrift server to
> query
> some data.
>
> Some of these applications are java applications and the others are PHP
> applications.
>
> As I am an old fashioned java developer, I used to connect java
> applications
> to BD servers like Mysql using a JDBC driver. Is there a corresponding
> driver for connecting with Spark Sql Thrift server ? Or what is the library
> I need to use to connect to it?
>
>
> For PHP, what are the ways we can use to connect PHP applications to Spark
> Sql Thrift Server?
>
>
>
>
>
> --
> View this message in context:
>
> http://apache-spark-user-list.1001560.n3.nabble.com/Connecting-a-PHP-Java-ap
> plications-to-Spark-SQL-Thrift-Server-tp21902.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org For additional
> commands, e-mail: user-help@spark.apache.org
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
>


-- 

[image: Sigmoid Analytics] <http://htmlsig.com/www.sigmoidanalytics.com>

*Arush Kharbanda* || Technical Teamlead

arush@sigmoidanalytics.com || www.sigmoidanalytics.com

Mime
View raw message