beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aljoscha Krettek (JIRA)" <j...@apache.org>
Subject [jira] [Closed] (BEAM-1445) Use Flink broadcast state to store side-input data
Date Thu, 16 Feb 2017 11:28:41 GMT

     [ https://issues.apache.org/jira/browse/BEAM-1445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Aljoscha Krettek closed BEAM-1445.
----------------------------------
       Resolution: Fixed
    Fix Version/s: 0.6.0

> Use Flink broadcast state to store side-input data
> --------------------------------------------------
>
>                 Key: BEAM-1445
>                 URL: https://issues.apache.org/jira/browse/BEAM-1445
>             Project: Beam
>          Issue Type: Improvement
>          Components: runner-flink
>            Reporter: Jingsong Lee
>            Assignee: Jingsong Lee
>             Fix For: 0.6.0
>
>
> By using the broadcast state to store side-input data we make operators rescalable. What
BROADCAST does is collect all checkpointed states into one "list" and then send out that list
to all parallel subtasks when restoring.The way we would use it is to only checkpoint anything
from the operator with subtask index 0 because we assume that the state is the same on all
parallel instances of the operator.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message