flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Stefan Richter (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-6984) Do not recover CompletedCheckpointStore on every restore
Date Thu, 22 Jun 2017 09:01:11 GMT
Stefan Richter created FLINK-6984:

             Summary: Do not recover CompletedCheckpointStore on every restore
                 Key: FLINK-6984
                 URL: https://issues.apache.org/jira/browse/FLINK-6984
             Project: Flink
          Issue Type: Improvement
          Components: State Backends, Checkpointing
    Affects Versions: 1.2.1, 1.3.0, 1.4.0
            Reporter: Stefan Richter

Currently, restoring the latest checkpoint always recovers the {{CompletedCheckpointStore}}
in {{CheckpointCoordinator::restoreLatestCheckpointedState(...)}} by calling {{completedCheckpointStore.recover(sharedStateRegistry)}}.
I think this is not required on every restore, but can happen only once when the JM becomes
leader, e.g. when the {{CheckpointCoordinator}} is created. This can avoid unnecessary work
and simplify the logic, e.g. for populating the {{SharedStateRegistry}}, and we could probably
also move the ownership for {{SharedStateRegistry}} into some {{AbstractCompletedCheckpontStore}}.

This message was sent by Atlassian JIRA

View raw message