Just sharing what I saw,

It claims to support kafka, files and databases. However, continuous SQL will be available in 2.1 or later only


On Fri, May 6, 2016 at 1:06 PM, Michael Malak <> wrote:
At first glance, it looks like the only streaming data sources available out of the box from the github master branch are and . Out of the Jira epic for Structured Streaming it would seem the still-open "API design: data sources and sinks" is relevant here.

In short, it would seem the code is not there yet to create a Kafka-fed Dataframe/Dataset that can be queried with Structured Streaming; or if it is, it's not obvious how to write such code.

From: Anthony May <>
To: Deepak Sharma <>; Sunita Arvind <>
Cc: "" <>
Sent: Friday, May 6, 2016 11:50 AM
Subject: Re: Adhoc queries on Spark 2.0 with Structured Streaming

Yeah, there isn't even a RC yet and no documentation but you can work off the code base and test suites:
And this might help:

On Fri, 6 May 2016 at 11:07 Deepak Sharma <> wrote:
Spark 2.0 is yet to come out for public release.
I am waiting to get hands on it as well.
Please do let me know if i can download source and build spark2.0 from github.


On Fri, May 6, 2016 at 9:51 PM, Sunita Arvind <> wrote:
Hi All,

We are evaluating a few real time streaming query engines and spark is my personal choice. The addition of adhoc queries is what is getting me further excited about it, however the talks I have heard so far only mention about it but do not provide details. I need to build a prototype to ensure it works for our use cases. 

Can someone point me to relevant material for this.