spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From 张万新 <kevinzwx1...@gmail.com>
Subject Will an input event older than watermark be dropped?
Date Wed, 06 Sep 2017 12:31:16 GMT
Hi,

I'm investigating the watermark for some time, according to the guide, if
we specify a watermark on event time column, the watermark will be used to
drop old state data. Then, take window-based count for example, if an event
whose time is older than the watermark comes, it will be simply dropped, or
a new count result be calculated for corresponding window?

Mime
View raw message