flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zhu Zhu (Jira)" <j...@apache.org>
Subject [jira] [Updated] (FLINK-14058) FLIP-53 Fine Grained Operator Resource Management
Date Wed, 08 Jan 2020 09:40:00 GMT

     [ https://issues.apache.org/jira/browse/FLINK-14058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Zhu Zhu updated FLINK-14058:
----------------------------
    Release Note: 
The memory configs for table operators are weight hints now rather than absolute memory requirements.
The configs includes
 * table.exec.resource.external-buffer-memory, 
 * table.exec.resource.hash-agg.memory, 
 * table.exec.resource.hash-join.memory, and
 * table.exec.resource.sort.memory.
In this way, operators would be able to make use of all the managed memory of a slot. It helps
the task to run more stable if the slot managed memory is limited, or more efficient if their
are adequate slot managed memory.

  was:
The memory configs for table operators, including 
 * table.exec.resource.external-buffer-memory, 
 * table.exec.resource.hash-agg.memory, 
 * table.exec.resource.hash-join.memory, and
 * table.exec.resource.sort.memory, 
 are just weight hints now rather than absolute memory requirements. In this way, operators
would be able to make use of all the managed memory of a slot. This helps the task to run
more stable if the slot managed memory is limited, or more efficient if their are adequate
slot managed memory.


> FLIP-53 Fine Grained Operator Resource Management
> -------------------------------------------------
>
>                 Key: FLINK-14058
>                 URL: https://issues.apache.org/jira/browse/FLINK-14058
>             Project: Flink
>          Issue Type: New Feature
>          Components: Runtime / Coordination
>    Affects Versions: 1.9.0
>            Reporter: Xintong Song
>            Assignee: Zhu Zhu
>            Priority: Major
>              Labels: Umbrella
>             Fix For: 1.10.0
>
>
> This is the umbrella issue of 'FLIP-53: Fine Grained Operator Resource Management'.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message