flink-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FLINK-9875) Add concurrent creation of execution job vertex
Date Sun, 22 Jul 2018 14:04:01 GMT

    [ https://issues.apache.org/jira/browse/FLINK-9875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16552025#comment-16552025
] 

ASF GitHub Bot commented on FLINK-9875:
---------------------------------------

Github user StephanEwen commented on the issue:

    https://github.com/apache/flink/pull/6353
  
    Maybe we can solve this simpler? Avoiding concurrency in the execution graph creation
makes the code simpler and more robust - very desirable for an already fairly complex construct.
    
    The issue here is the time it takes to create the splits, so we could see if we parallelize
that, rather than parallelizing the job vertex creation.
    
    I would think in the direction of having a Future that supplies the input splits and computing
the future in the IOExecutor. That would parallelize the core problem and leave the executiongraph
as it is.


> Add concurrent creation of execution job vertex
> -----------------------------------------------
>
>                 Key: FLINK-9875
>                 URL: https://issues.apache.org/jira/browse/FLINK-9875
>             Project: Flink
>          Issue Type: Improvement
>          Components: Local Runtime
>    Affects Versions: 1.5.1
>            Reporter: 陈梓立
>            Assignee: 陈梓立
>            Priority: Major
>              Labels: pull-request-available
>
> in some case like inputformat vertex, creation of execution job vertex is time
> consuming, this pr add concurrent creation of execution job vertex to accelerate it.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message