flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Stephan Ewen (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-2221) Checkpoints to "file://" are not cleaned up
Date Wed, 12 Oct 2016 17:46:20 GMT

    [ https://issues.apache.org/jira/browse/FLINK-2221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15569386#comment-15569386
] 

Stephan Ewen commented on FLINK-2221:
-------------------------------------

I would like to close this as "won't fix", because it is expected. In a distributed system,
checkpointing to locations that are only locally accessible cannot work.

Supporting "file://" is still valid, because many NFS-like filesystems would be addressed
via that scheme.

> Checkpoints to "file://" are not cleaned up
> -------------------------------------------
>
>                 Key: FLINK-2221
>                 URL: https://issues.apache.org/jira/browse/FLINK-2221
>             Project: Flink
>          Issue Type: Bug
>          Components: Streaming
>            Reporter: Aljoscha Krettek
>
> If you think about it, this could never work. The state handle cleanup logic happens
purely on the JobManager. So what happens is that the TaskManagers create state in some directory,
let's say /tmp/checkpoints, on the TaskManager. For cleanup, the JobManager gets the state
handle and calls discard (on the JobManager), this tries to cleanup the state in /tmp/checkpoints,
but of course, there is nothing there since we are still on the JobManager.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message