spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From kant kodali <>
Subject Queries with streaming sources must be executed with writeStream.start()
Date Sat, 09 Sep 2017 23:04:33 GMT
Hi All,

I  have the following code and I am not sure what's wrong with it? I cannot
call dataset.toJSON() (which returns a DataSet) ? I am using spark 2.2.0 so
I am wondering if there is any work around?

 Dataset<String> ds = newDS.toJSON().map(()->{some function that
returns a string});
 StreamingQuery query = ds.writeStream().start();

View raw message