flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Kostas (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-2319) Collect size limitation due to akka.
Date Sun, 05 Jul 2015 17:53:05 GMT
Kostas created FLINK-2319:

             Summary: Collect size limitation due to akka.
                 Key: FLINK-2319
                 URL: https://issues.apache.org/jira/browse/FLINK-2319
             Project: Flink
          Issue Type: New Feature
          Components: JobManager, TaskManager
    Affects Versions: 0.10
            Reporter: Kostas

Each TaksManager keeps the results of a local task in a set of Accumulators. Upon termination
of the task, the Accumulators are sent back to the JobManager, who merges them, before sending
them back to the Client. 

To exchange the Accumulators and their content, akka is used. This limits the size of the
output of a task to no more than akka.framesize bytes. In other case, akka would drop the

This ticket is to propose the removal of this limitation so that results can be of arbitrary

This message was sent by Atlassian JIRA

View raw message