spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ofir Manor <>
Subject Re: The Future Of DStream
Date Wed, 27 Jul 2016 07:03:20 GMT
Structured Streaming in 2.0 is declared as alpha - plenty of bits still
I assume that it will be declared stable / GA in a future 2.x release, and
then it will co-exist with DStream for quite a while before someone will
suggest to start a deprecation process that will eventually lead to its
As a user, I guess we will need to apply judgement about when to switch to
Structured Streaming - each of us have a different risk/value tradeoff,
based on our specific situation...

Ofir Manor

Co-Founder & CTO | Equalum

Mobile: +972-54-7801286 | Email:

On Wed, Jul 27, 2016 at 8:02 AM, Chang Chen <> wrote:

> Hi guys
> Structure Stream is coming with spark 2.0,  but I noticed that DStream is
> still here
> What's the future of the DStream, will it be deprecated and removed
> eventually? Or co-existed with  Structure Stream forever?
> Thanks
> Chang

View raw message