flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Márton Balassi (JIRA) <j...@apache.org>
Subject [jira] [Created] (FLINK-1323) Implement memory management profiles
Date Fri, 12 Dec 2014 18:34:13 GMT
Márton Balassi created FLINK-1323:
-------------------------------------

             Summary: Implement memory management profiles
                 Key: FLINK-1323
                 URL: https://issues.apache.org/jira/browse/FLINK-1323
             Project: Flink
          Issue Type: Improvement
          Components: Distributed Runtime
    Affects Versions: 0.8-incubating
            Reporter: Márton Balassi


Flink currently allocates a sizeable chunk of the JVM heap for the framework, where hashing
and sorting is done amongst others. This enables graceful spilling to disk, when this datasize
exceeds memory, however might be counterproductive for jobs with large user state and is completely
unutilized by streaming at the moment.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message