spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From subramgr <subramanian.gir...@gmail.com>
Subject [Structured Streaming] Two watermarks and StreamingQueryListener
Date Thu, 09 Aug 2018 22:15:27 GMT
Hi, 

We have two *flatMapGroupWithState* in our job and we have two
*withWatermark*

We are getting the event max time, event time and watermarks from
*QueryProgressEvent*. 

Right now it just returns one *watermark* value. 

Are two watermarks maintained by Spark or just one. 
If one which one
If one watermark is maintained per *Dataframe* how do I get the values for
them ?




--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org


Mime
View raw message