spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jacek Laskowski <ja...@japila.pl>
Subject Re: spark 2.0 readStream from a REST API
Date Tue, 02 Aug 2016 09:50:53 GMT
On Tue, Aug 2, 2016 at 10:59 AM, Ayoub Benali
<benali.ayoub.info@gmail.com> wrote:
> Why writeStream is needed to consume the data ?

You need to start your structured streaming (query) and there's no way
to access it without DataStreamWriter => writeStream's a must.

http://spark.apache.org/docs/latest/api/scala/index.html#org.apache.spark.sql.streaming.DataStreamWriter

Pozdrawiam,
Jacek Laskowski
----
https://medium.com/@jaceklaskowski/
Mastering Apache Spark 2.0 http://bit.ly/mastering-apache-spark
Follow me at https://twitter.com/jaceklaskowski

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org


Mime
View raw message