flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-7683) Add method to iterate over all of the existing keys in a statebackend
Date Wed, 27 Sep 2017 08:27:01 GMT

    [ https://issues.apache.org/jira/browse/FLINK-7683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16182179#comment-16182179

ASF GitHub Bot commented on FLINK-7683:

Github user StefanRRichter commented on the issue:

    I have one more talking point for this: the behaviour of the iterators for RocksDB and
heap backends are different now: for RocksDB we iterate over a snapshot of the data and modifications
concurrently (by that, I mean not in a different thread, but just interleaved with the iteration
in the same thread) to the iteration will work and not be reflected in the iterator. In the
heap backend, the concurrent modifications will make the iterator fail. Is this a problem
for the intended use case and what is the expected behaviour?

> Add method to iterate over all of the existing keys in a statebackend
> ---------------------------------------------------------------------
>                 Key: FLINK-7683
>                 URL: https://issues.apache.org/jira/browse/FLINK-7683
>             Project: Flink
>          Issue Type: New Feature
>          Components: State Backends, Checkpointing
>            Reporter: Piotr Nowojski
>            Assignee: Piotr Nowojski
> This is required to make possible preserving backward compatibility while changing state
definition of a keyed state operator (to do so operator must iterate over all of the existing
keys and rewrites them into a new state variable).

This message was sent by Atlassian JIRA

View raw message