spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rohit Rai <>
Subject Re: Announcing Spark SQL
Date Thu, 27 Mar 2014 05:59:43 GMT
Great work guys! Have been looking forward to this . . .

In the blog it mentions support for reading from Hbase/Avro... What will be
the recommended approach for this? Will it be writing custom wrappers for
SQLContext like in HiveContext or using Hive's "EXTERNAL TABLE" support?

I ask this because a few days back (based on your pull request in github) I
started analyzing what it would take to support Spark SQL on Cassandra. One
obvious approach will be to use Hive External Table support with our
cassandra-hive handler. But second approach sounds tempting as it will give
more fidelity.


*Founder & CEO, **Tuplejump, Inc.*
*The Data Engineering Platform*

On Thu, Mar 27, 2014 at 9:12 AM, Michael Armbrust <>wrote:

> Any plans to make the SQL typesafe using something like Slick (
> I would really like to do something like that, and maybe we will in a
> couple of months. However, in the near term, I think the top priorities are
> going to be performance and stability.
> Michael

View raw message