flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sachin Goel (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-2732) Add access to the TaskManagers' log file and out file in the web dashboard.
Date Mon, 12 Oct 2015 05:31:05 GMT

    [ https://issues.apache.org/jira/browse/FLINK-2732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14952658#comment-14952658
] 

Sachin Goel commented on FLINK-2732:
------------------------------------

Hey [~mliesenberg], I'm not sure uploading the logs to jobmanager, and then serving from there
is a good idea. There are three network hops involved: Front end -> Web Monitor -> Job
Manager -> Task Manager.
How about something like this:
1. Start a minimal blob service at the task manager which searches for files by name in the
log directory. You can use a file name filter for this.
2. Include the blob service port in metrics.
3. Send a request of the format /blobfilehandler?url=<task_manager_akka_host>&port=<task_manager_blob_port>
from angular.
4. The web monitor access the files and sends them back to the front end.

Although someone else should perhaps comment on whether just serving this purpose calls for
starting a blob service on the task manager.

> Add access to the TaskManagers' log file and out file in the web dashboard.
> ---------------------------------------------------------------------------
>
>                 Key: FLINK-2732
>                 URL: https://issues.apache.org/jira/browse/FLINK-2732
>             Project: Flink
>          Issue Type: Sub-task
>          Components: Webfrontend
>    Affects Versions: 0.10
>            Reporter: Stephan Ewen
>            Assignee: Martin Liesenberg
>             Fix For: 0.10
>
>
> Add access to the TaskManagers' log file and out file in the web dashboard.
> This needs addition on the server side, as the log files need to be transferred   to
the JobManager via the blob server.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message