flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Metzger (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-3427) Add watermark monitoring to JobManager web frontend
Date Tue, 06 Sep 2016 20:52:21 GMT

    [ https://issues.apache.org/jira/browse/FLINK-3427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15468531#comment-15468531

Robert Metzger commented on FLINK-3427:

[~ivan.mushketyk] did you already start working on this issue? I'm asking because I have somebody
who wanted to implement this soon, and we have some concrete plans how to do it.
If you're already half-way through with the implementation, you can get the task and finish
it. However, if you did not start yet, I'm wondering whether it would be okay for you if I
can take the task?

I'm sorry that I didn't see your comment three days ago earlier.

> Add watermark monitoring to JobManager web frontend
> ---------------------------------------------------
>                 Key: FLINK-3427
>                 URL: https://issues.apache.org/jira/browse/FLINK-3427
>             Project: Flink
>          Issue Type: Improvement
>          Components: Streaming, Webfrontend
>            Reporter: Robert Metzger
>            Assignee: Ivan Mushketyk
> Currently, its quite hard to figure out issues with the watermarks.
> I think we can improve the situation by reporting the following information through the
metrics system:
> - Report the current low watermark for each operator (this way, you can see if one operator
is preventing the watermarks to rise)
> - Report the number of events arrived after the low watermark (users can see how accurate
the watermarks are)

This message was sent by Atlassian JIRA

View raw message