flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ufuk Celebi (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (FLINK-1404) Add support to cache intermediate results
Date Tue, 07 Apr 2015 08:52:12 GMT

     [ https://issues.apache.org/jira/browse/FLINK-1404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Ufuk Celebi updated FLINK-1404:
-------------------------------
    Summary: Add support to cache intermediate results  (was: Trigger recycling of buffers
held by historic intermediate result partitions)

> Add support to cache intermediate results
> -----------------------------------------
>
>                 Key: FLINK-1404
>                 URL: https://issues.apache.org/jira/browse/FLINK-1404
>             Project: Flink
>          Issue Type: Improvement
>          Components: Distributed Runtime
>            Reporter: Ufuk Celebi
>            Assignee: Ufuk Celebi
>
> With blocking intermediate results (FLINK-1350) and proper partition state management
(FLINK-1359) it is necessary to allow the network buffer pool to request eviction of historic
intermediate results when not enough buffers are available. With the currently available pipelined
intermediate partitions this is not an issue, because buffer pools can be released as soon
as a partition is consumed.
> We need to be able to trigger the recycling of buffers held by historic intermediate
results when not enough buffers are available for new local pools.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message