flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-2319) Collect size limitation due to akka.
Date Sun, 05 Jul 2015 18:04:04 GMT

    [ https://issues.apache.org/jira/browse/FLINK-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14614340#comment-14614340
] 

ASF GitHub Bot commented on FLINK-2319:
---------------------------------------

Github user chiwanpark commented on the pull request:

    https://github.com/apache/flink/pull/887#issuecomment-118644497
  
    FLINK-2319,
    I leave a commit with the JIRA ticket to track changes of this PR. :)


> Collect size limitation due to akka.
> ------------------------------------
>
>                 Key: FLINK-2319
>                 URL: https://issues.apache.org/jira/browse/FLINK-2319
>             Project: Flink
>          Issue Type: New Feature
>          Components: JobManager, TaskManager
>    Affects Versions: 0.10
>            Reporter: Kostas
>
> Each TaksManager keeps the results of a local task in a set of Accumulators. Upon termination
of the task, the Accumulators are sent back to the JobManager, who merges them, before sending
them back to the Client. 
> To exchange the Accumulators and their content, akka is used. This limits the size of
the output of a task to no more than akka.framesize bytes. In other case, akka would drop
the message.
> This ticket is to propose the removal of this limitation so that results can be of arbitrary
size.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message