flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-5046) Avoid redundant serialization when creating the TaskDeploymentDescriptor
Date Thu, 10 Nov 2016 17:32:59 GMT

    [ https://issues.apache.org/jira/browse/FLINK-5046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15654627#comment-15654627
] 

ASF GitHub Bot commented on FLINK-5046:
---------------------------------------

Github user tillrohrmann commented on the issue:

    https://github.com/apache/flink/pull/2779
  
    Tests pass locally. Will merge the PR.


> Avoid redundant serialization when creating the TaskDeploymentDescriptor
> ------------------------------------------------------------------------
>
>                 Key: FLINK-5046
>                 URL: https://issues.apache.org/jira/browse/FLINK-5046
>             Project: Flink
>          Issue Type: Improvement
>          Components: Distributed Coordination
>    Affects Versions: 1.2.0, 1.1.3
>            Reporter: Till Rohrmann
>            Assignee: Till Rohrmann
>             Fix For: 1.2.0, 1.1.4
>
>
> When creating the {{TaskDeploymentDescriptor}} we extract information from the {{ExecutionGraph}}
which is defined job-wide and from the {{ExecutionJobVertex}} which is defined operator-wide.
The extracted information will be serialized for every subtask even though it stays the same.

> As an improvement, we can serialize this information once and give the serialized byte
array to the {{TaskDeploymentDescriptor}}. This will reduce the serialization work Flink has
to do when deploying sub tasks.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message