spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael Armbrust <mich...@databricks.com>
Subject Re: Storage Handlers in Spark SQL
Date Mon, 25 Aug 2014 20:17:07 GMT
- dev list
+ user list

You should be able to query Spark SQL using JDBC, starting with the 1.1
release.  There is some documentation is the repo
<https://github.com/apache/spark/blob/master/docs/sql-programming-guide.md#running-the-thrift-jdbc-server>,
and we'll update the official docs once the release is out.


On Thu, Aug 21, 2014 at 4:43 AM, Niranda Perera <niranda@wso2.com> wrote:

> Hi,
>
> I have been playing around with Spark for the past few days, and evaluating
> the possibility of migrating into Spark (Spark SQL) from Hive/Hadoop.
>
> I am working on the WSO2 Business Activity Monitor (WSO2 BAM,
>
> https://docs.wso2.com/display/BAM241/WSO2+Business+Activity+Monitor+Documentation
> ) which has currently employed Hive. We are considering Spark as a
> successor for Hive, given it's performance enhancement.
>
> We have currently employed several custom storage-handlers in Hive.
> Example:
> WSO2 JDBC and Cassandra storage handlers:
> https://docs.wso2.com/display/BAM241/JDBC+Storage+Handler+for+Hive
>
> https://docs.wso2.com/display/BAM241/Creating+Hive+Queries+to+Analyze+Data#CreatingHiveQueriestoAnalyzeData-cas
>
> I would like to know where Spark SQL can work with these storage
> handlers (while using HiveContext may be) ?
>
> Best regards
> --
> *Niranda Perera*
> Software Engineer, WSO2 Inc.
> Mobile: +94-71-554-8430
> Twitter: @n1r44 <https://twitter.com/N1R44>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message