flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Greg Hogan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-3302) Save Taskmanager Metrics per Job
Date Thu, 13 Oct 2016 19:41:20 GMT

    [ https://issues.apache.org/jira/browse/FLINK-3302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15572952#comment-15572952
] 

Greg Hogan commented on FLINK-3302:
-----------------------------------

I recently closed the aforementioned FLINK-3263 since these statistics can be collected and
stored using a [Metrics Reporter|https://ci.apache.org/projects/flink/flink-docs-master/monitoring/metrics.html].
The simplest reporter is the {{StatsDReporter}}. Logging these stats can be done with a [short
Python script|http://www.slideshare.net/FlinkForward/greg-hogan-to-petascale-and-beyond-apache-flink-in-the-clouds/43].
Does this satisfy your use case?

> Save Taskmanager Metrics per Job
> --------------------------------
>
>                 Key: FLINK-3302
>                 URL: https://issues.apache.org/jira/browse/FLINK-3302
>             Project: Flink
>          Issue Type: Wish
>          Components: JobManager, Webfrontend
>            Reporter: Pieter Hameete
>            Priority: Minor
>
> As followup to my email in the user mailing list:
> It would be nice if there is a configuration option to have the JobManager save the received
metrics for each of the TaskManagers per separate job. This information can be useful for
later analysis of job performance.
> The Metrics are currently already received by the JobManager and shown/updated in the
Web UI every few seconds. It should not be very difficult to write these timestamped updates
to disk and group per job.
> This is something I could pick up myself in a couple of months.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message