flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-5046) Avoid redundant serialization when creating the TaskDeploymentDescriptor
Date Thu, 10 Nov 2016 17:32:59 GMT

    [ https://issues.apache.org/jira/browse/FLINK-5046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15654627#comment-15654627

ASF GitHub Bot commented on FLINK-5046:

Github user tillrohrmann commented on the issue:

    Tests pass locally. Will merge the PR.

> Avoid redundant serialization when creating the TaskDeploymentDescriptor
> ------------------------------------------------------------------------
>                 Key: FLINK-5046
>                 URL: https://issues.apache.org/jira/browse/FLINK-5046
>             Project: Flink
>          Issue Type: Improvement
>          Components: Distributed Coordination
>    Affects Versions: 1.2.0, 1.1.3
>            Reporter: Till Rohrmann
>            Assignee: Till Rohrmann
>             Fix For: 1.2.0, 1.1.4
> When creating the {{TaskDeploymentDescriptor}} we extract information from the {{ExecutionGraph}}
which is defined job-wide and from the {{ExecutionJobVertex}} which is defined operator-wide.
The extracted information will be serialized for every subtask even though it stays the same.

> As an improvement, we can serialize this information once and give the serialized byte
array to the {{TaskDeploymentDescriptor}}. This will reduce the serialization work Flink has
to do when deploying sub tasks.

This message was sent by Atlassian JIRA

View raw message