spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jacek Laskowski <ja...@japila.pl>
Subject [SS] How to know what events were late in a streaming batch?
Date Sun, 03 Sep 2017 11:17:56 GMT
Hi,

I've asked this question on SO [1], but hope to catch more attention
posting here.

I'd like to know how many events were late in a streaming batch in
Structured Streaming. Is there a way to know the number or (better)
what events exactly were late?

Thanks for any help you may offer!

[1] https://stackoverflow.com/q/46022876/1305344

Pozdrawiam,
Jacek Laskowski
----
https://about.me/JacekLaskowski
Spark Structured Streaming (Apache Spark 2.2+)
https://bit.ly/spark-structured-streaming
Mastering Apache Spark 2 https://bit.ly/mastering-apache-spark
Follow me at https://twitter.com/jaceklaskowski

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org


Mime
View raw message