spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From purna pradeep <purna2prad...@gmail.com>
Subject Restart streaming query spark 2.1 structured streaming
Date Tue, 15 Aug 2017 16:40:01 GMT
Hi,

>
> I'm trying to restart a streaming query to refresh cached data frame
>
> Where and how should I restart streaming query
>


val sparkSes = SparkSession

      .builder

      .config("spark.master", "local")

      .appName("StreamingCahcePoc")

      .getOrCreate()



    import sparkSes.implicits._



    val dataDF = sparkSes.readStream

      .schema(streamSchema)

      .csv("testData")





       val query = counts.writeStream

      .outputMode("complete")

      .format("console")

      .start()


query.awaittermination()



>
>
>

Mime
View raw message