flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Stephan Ewen (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-986) Add intermediate results to distributed runtime
Date Mon, 08 Sep 2014 11:50:28 GMT

    [ https://issues.apache.org/jira/browse/FLINK-986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14125427#comment-14125427

Stephan Ewen commented on FLINK-986:

I think that is beyond the scope of our immediate efforts.

In the first step, these intermediate results will be immutable. Once that is done and working
properly, we could kick off a discussion about making them mutable.

However, that makes all recovery logic very complicated. Might make sense to think in the
direction of applying deltas, maybe in the form of log-structured tables or so.

> Add intermediate results to distributed runtime
> -----------------------------------------------
>                 Key: FLINK-986
>                 URL: https://issues.apache.org/jira/browse/FLINK-986
>             Project: Flink
>          Issue Type: New Feature
>          Components: Distributed Runtime
>            Reporter: Ufuk Celebi
>            Assignee: Ufuk Celebi
>            Priority: Blocker
> Support for intermediate results in the runtime is currently blocking different efforts
like fault tolerance or result collection at the client.

This message was sent by Atlassian JIRA

View raw message