spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From subramgr <>
Subject [Structured Streaming] Two watermarks and StreamingQueryListener
Date Thu, 09 Aug 2018 22:15:27 GMT

We have two *flatMapGroupWithState* in our job and we have two

We are getting the event max time, event time and watermarks from

Right now it just returns one *watermark* value. 

Are two watermarks maintained by Spark or just one. 
If one which one
If one watermark is maintained per *Dataframe* how do I get the values for
them ?

Sent from:

To unsubscribe e-mail:

View raw message