flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Stephan Ewen (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-2732) Add access to the TaskManagers' log file and out file in the web dashboard.
Date Thu, 01 Oct 2015 07:16:04 GMT

    [ https://issues.apache.org/jira/browse/FLINK-2732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14939416#comment-14939416
] 

Stephan Ewen commented on FLINK-2732:
-------------------------------------

The BlobServer has two modes to store data:

  - By BlobKey, which is a has of its contents. This mode is used for libraries, where we
check via the hash whether they are already contained, or whether they need to be moved from
the blob server (JobManager) to the cache (TaskManager)

  - By String key and JobID - this is for general purpose data scoped by a job (will be cleared
once job is shut down)

You should be able to use the second variant, with a special constant JobID that signifies
these log operations. Use this to transfer the log to the JobManager's blob server. You should
then be able to get the File path of the temp file that stores the log file.

In the netty router, you can probably add a special static file handler (similar to the static
contents handler) that serves these files.

> Add access to the TaskManagers' log file and out file in the web dashboard.
> ---------------------------------------------------------------------------
>
>                 Key: FLINK-2732
>                 URL: https://issues.apache.org/jira/browse/FLINK-2732
>             Project: Flink
>          Issue Type: Sub-task
>          Components: Webfrontend
>    Affects Versions: 0.10
>            Reporter: Stephan Ewen
>            Assignee: Martin Liesenberg
>             Fix For: 0.10
>
>
> Add access to the TaskManagers' log file and out file in the web dashboard.
> This needs addition on the server side, as the log files need to be transferred   to
the JobManager via the blob server.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message