flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yang Wang (Jira)" <j...@apache.org>
Subject [jira] [Updated] (FLINK-14582) Do not upload {uuid}-taskmanager-conf.yaml for each task manager container
Date Thu, 31 Oct 2019 08:07:00 GMT

     [ https://issues.apache.org/jira/browse/FLINK-14582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Yang Wang updated FLINK-14582:
------------------------------
    Description: 
Currently when we {{createTaskExecutorLaunchContext}}, a new task manager conf will be created
and uploaded to hdfs. The time cost is unnecessary and could be reduced by using java options
of task manager main class instead.

By reducing the time of launch container in {{onContainersAllocated}}, we could avoid allocating
excess containers as much as possible.

  was:
Currently when we {{createTaskExecutorLaunchContext}}, a new task manager conf will be created
and uploaded to hdfs. The time cost is unnecessary and could be reduced by using java options
of task manager main class instead.

By reducing the time of launch container in {{onContainersAllocated}}, we could avoid allocating
excess containers as 


> Do not upload {uuid}-taskmanager-conf.yaml for each task manager container
> --------------------------------------------------------------------------
>
>                 Key: FLINK-14582
>                 URL: https://issues.apache.org/jira/browse/FLINK-14582
>             Project: Flink
>          Issue Type: Improvement
>            Reporter: Yang Wang
>            Priority: Major
>
> Currently when we {{createTaskExecutorLaunchContext}}, a new task manager conf will be
created and uploaded to hdfs. The time cost is unnecessary and could be reduced by using java
options of task manager main class instead.
> By reducing the time of launch container in {{onContainersAllocated}}, we could avoid
allocating excess containers as much as possible.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message