flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "vinoyang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-11782) Enhance TaskManager log visualization by listing all log files for Flink web UI
Date Mon, 04 Mar 2019 12:34:00 GMT

    [ https://issues.apache.org/jira/browse/FLINK-11782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16783339#comment-16783339
] 

vinoyang commented on FLINK-11782:
----------------------------------

[~StephanEwen] [~till.rohrmann] and [~Zentol] If we don't pay attention to the [Flink log
separation|[https://docs.google.com/document/d/1TTYAtFoTWaGCveKDZH394FYdRyNyQFnVoW5AYFvnr5I/edit?usp=sharing]],
what do you think about this issue? It is intended to list all the log files under the Task
Manager's log path, which is very helpful in locating the problem.

> Enhance TaskManager log visualization by listing all log files for Flink web UI
> -------------------------------------------------------------------------------
>
>                 Key: FLINK-11782
>                 URL: https://issues.apache.org/jira/browse/FLINK-11782
>             Project: Flink
>          Issue Type: Improvement
>          Components: Runtime / Web Frontend
>            Reporter: vinoyang
>            Assignee: vinoyang
>            Priority: Major
>         Attachments: flink-web-ui-taskmanager-log-files-2.png, flink-web-ui-taskmanager-log-files.png,
yarn-container-log-files.png
>
>
> Currently, there are some features to be enhanced when Flink web UI displays TaskManager
logs:
> 1) Flink web UI can only display the log of task manager and stdout;
> 2) Flink web UI can only display the latest one log file;
> In the log folder of a Task Manager, we usually have more files, including GC log files,
multiple files generated based on the rolling rules of the logging framework (time or log
file size), user's business log files (We internally implemented the separation of Flink from
the user log). For these files, the current Flink web UI cannot be displayed.
> I personally suggest that we can refer to the way YARN displays the container's log (see
attachment 1), first list all the log files (see attachment 2), and then click to display
the files of these logs.
>  
> This feature can be independent or part of the log separation (see FLINK-11202).
> It has now been added to the design documentation for Log separation: https://docs.google.com/document/d/1TTYAtFoTWaGCveKDZH394FYdRyNyQFnVoW5AYFvnr5I/edit?usp=sharing



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message