spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GOEL Rajat <rajat.g...@thalesgroup.com>
Subject Structured Streaming metric for count of delayed/late data
Date Thu, 20 Aug 2020 07:57:44 GMT
Hi All,

I have a query if someone can please help. Is there any metric or mechanism of printing count
of input records dropped due to watermarking (late data count) in a stream, during a window
based aggregation, in Structured Streaming ? I am using Spark 3.0.

Thanks & Regards,
Rajat
Mime
View raw message