spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Christopher Nguyen <>
Subject Re: Opiq for SParkSQL?
Date Sat, 07 Jun 2014 20:26:43 GMT
Yan, it looks like Julian did anticipate exactly this possibility:

Optiq is a cool project vision in terms of hiding various engines behind
one consistent API.

That said, from just the Spark perspective, I don't see a huge value add to
layer Optiq above SparkSQL---until and unless Optiq provides a lot more
idioms and/or operational facilities than just making Spark RDDs look like
tables, which SparkSQL already does quite nicely and increasingly.
Warehousing, perhaps?

Here, I can't avoid a mention of DDF which aims to add more algorithmic and
data manipulation value in addition to the table abstraction (
Christopher T. Nguyen
Co-founder & CEO, Adatao <>

On Fri, Jun 6, 2014 at 11:26 AM, Yan <> wrote:

> Can anybody share your thoughts/comments/interests of applicability of the
> "optiq"  framework to Spark, and SparkSQL in particular?
> Thanks,

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message