flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Till Rohrmann (JIRA)" <j...@apache.org>
Subject [jira] [Created] (FLINK-5046) Avoid redundant serialization when creating the TaskDeploymentDescriptor
Date Thu, 10 Nov 2016 00:46:58 GMT
Till Rohrmann created FLINK-5046:
------------------------------------

             Summary: Avoid redundant serialization when creating the TaskDeploymentDescriptor
                 Key: FLINK-5046
                 URL: https://issues.apache.org/jira/browse/FLINK-5046
             Project: Flink
          Issue Type: Improvement
          Components: Distributed Coordination
    Affects Versions: 1.1.3, 1.2.0
            Reporter: Till Rohrmann
            Assignee: Till Rohrmann
             Fix For: 1.2.0, 1.1.4


When creating the {{TaskDeploymentDescriptor}} we extract information from the {{ExecutionGraph}}
which is defined job-wide and from the {{ExecutionJobVertex}} which is defined operator-wide.
The extracted information will be serialized for every subtask even though it stays the same.


As an improvement, we can serialize this information once and give the serialized byte array
to the {{TaskDeploymentDescriptor}}. This will reduce the serialization work Flink has to
do when deploying sub tasks.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message