spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jacek Laskowski <>
Subject Re: Spark structured streaming
Date Tue, 08 Mar 2016 10:44:35 GMT
Hi Praveen,

I've spent few hours on the changes related to streaming dataframes
(included in the SPARK-8360) and concluded that it's currently only
possible to, but not since there are no
streaming Sinks yet.

Jacek Laskowski
Mastering Apache Spark
Follow me at

On Tue, Mar 8, 2016 at 10:38 AM, Praveen Devarao <> wrote:
> Hi,
>         I would like to get my hands on the structured streaming feature
> coming out in Spark 2.0. I have tried looking around for code samples to get
> started but am not able to find any. Only few things I could look into is
> the test cases that have been committed under the JIRA umbrella
> the test cases don't
> lead to building a example code as they seem to be working out of internal
> classes.
>         Could anyone point me to some resources or pointers in code that I
> can start with to understand structured streaming from a consumability
> angle.
> Thanking You
> ---------------------------------------------------------------------------------
> Praveen Devarao
> Spark Technology Centre
> IBM India Software Labs
> ---------------------------------------------------------------------------------
> "Courage doesn't always roar. Sometimes courage is the quiet voice at the
> end of the day saying I will try again"

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message