flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "shengjk1 (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-11789) Checkpoint directories are not cleaned up after job termination
Date Fri, 01 Mar 2019 14:36:00 GMT

    [ https://issues.apache.org/jira/browse/FLINK-11789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16781722#comment-16781722

shengjk1 commented on FLINK-11789:

i think  delete {{{{checkpoints/JOB_ID}} should contains three situations at least:}}

  1. the job is killed by user

  2. the job is canceled and the  \{{ExternalizedCheckpointCleanup}} is \{{DELETE_ON_CANCELLATION}}

  3. the job is fail

If the user manually specifies \{{checkpoints/JOB_ID}} as savepoint dir , this directory should
be kept, such as  flink cancel -s {{{{checkpoints/JOB_ID}}}}


> Checkpoint directories are not cleaned up after job termination
> ---------------------------------------------------------------
>                 Key: FLINK-11789
>                 URL: https://issues.apache.org/jira/browse/FLINK-11789
>             Project: Flink
>          Issue Type: Bug
>          Components: Runtime / Checkpointing
>    Affects Versions: 1.9.0
>            Reporter: Till Rohrmann
>            Priority: Major
> Flink currently does not clean up all checkpoint directories when a job reaches a globally
terminal state. Having configured the checkpoint directory {{checkpoints}}, I observe that
after cancelling the job {{JOB_ID}} there are still
> {code}
> checkpoints/JOB_ID/shared
> checkpoints/JOB_ID/taskowned
> {code}
> I think it would be good if would delete {{checkpoints/JOB_ID}}

This message was sent by Atlassian JIRA

View raw message