spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tathagata Das <>
Subject Re: Writing custom Structured Streaming receiver
Date Wed, 01 Nov 2017 18:27:20 GMT
Structured Streaming source APIs are not yet public, so there isnt a guide.
However, if you are adventurous enough, you can take a look at the source
code in Spark.
Source API:
Text socket source implementation:

Note that these APIs are still internal APIs and are very likely to change
in future versions of Spark.

On Wed, Nov 1, 2017 at 5:45 PM, Daniel Haviv <> wrote:

> Hi,
> Is there a guide to writing a custom Structured Streaming receiver?
> Thank you.
> Daniel

View raw message