flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From gyfora <...@git.apache.org>
Subject [GitHub] flink pull request: New operator state interfaces
Date Fri, 29 May 2015 10:42:11 GMT
GitHub user gyfora opened a pull request:

    https://github.com/apache/flink/pull/747

    New operator state interfaces

    This PR contains the proposed changes for the streaming operator state interfaces as described
in
    
    https://docs.google.com/document/d/1nTn4Tpafsnt-TCT6L1vlHtGGgRevU90yRsUQEmkRMjk/edit?usp=sharing
    
    Highlights:
    - Added OperatorState interface accessible from RuntimeContext
    - System managed checkpointing/restore of the states (no required implementations for
Serializable states)
    - confirmCheckpoint(..) method in the CheckpointCommitter interface has been changed to
return the StateHandle for the checkpointed state
    - Removed Checkpointed/AsynchronouslyCheckpointed interfaces
    - Updated Persistent Kafka source to work on the new interfaces (does not work properly
yet :/ )
    - Updated Tests and IT cases


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/gyfora/flink new_state

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/flink/pull/747.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #747
    
----
commit 9fe6bd39df4cc74c1708ba3f108339979497c5fb
Author: Gyula Fora <gyfora@apache.org>
Date:   2015-05-17T18:33:38Z

    [streaming] Initial rework of the operator state interfaces

commit 7eba5200fbad93af2bf28e9289864ded76091ef9
Author: Gyula Fora <gyfora@apache.org>
Date:   2015-05-28T09:07:42Z

    [streaming] Modified kafka source to use the new state interfaces

commit f5f32d95e41bc8da2f76656d0331965c2dfb06f0
Author: Gyula Fora <gyfora@apache.org>
Date:   2015-05-28T11:31:07Z

    [streaming] Allow multiple operator states + stateful function test rework

commit 9956d58eba92bd0c340bbd2e8a058d4adf57baa6
Author: Paris Carbone <seniorcarbone@gmail.com>
Date:   2015-05-28T13:07:49Z

    [streaming] Add stateHandle to checkpointed message

commit 1ae3faaad7ad6f5c65a7f69dc114c2b4535cacef
Author: Gyula Fora <gyfora@apache.org>
Date:   2015-05-29T09:47:44Z

    [streaming] Return null for empty state instead of empty hashmap

commit ac2f638a93b9b67be5e485b9d9e3a0c7a7644eee
Author: Paris Carbone <seniorcarbone@gmail.com>
Date:   2015-05-29T09:57:34Z

    [streaming] fix for null state in ConfirmCheckpoint messages

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

Mime
View raw message