flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ufuk Celebi (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-1359) Make IntermediateResultPartitionManager aware of consumed partitions
Date Tue, 06 Jan 2015 14:36:35 GMT
Ufuk Celebi created FLINK-1359:

             Summary: Make IntermediateResultPartitionManager aware of consumed partitions
                 Key: FLINK-1359
                 URL: https://issues.apache.org/jira/browse/FLINK-1359
             Project: Flink
          Issue Type: Improvement
          Components: Distributed Runtime
            Reporter: Ufuk Celebi
            Assignee: Ufuk Celebi

The current state of runtime support for intermediate results (see https://github.com/apache/incubator-flink/pull/254
and FLINK-986) does not distinguish between historic and currently produced/consumed intermediate
result partitions (e.g. only non-persistent intermediate results) in the intermediate result
partition manager.

For persistent intermediate results we need to distinguish between currently consumed results
and those that have already been produced and consumed. As a first step, historic results
can be evicted based on least recent use.

This message was sent by Atlassian JIRA

View raw message