tez-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hitesh Sharma (JIRA)" <j...@apache.org>
Subject [jira] [Created] (TEZ-4010) Use InputReadyVertexManager for broadcast connection
Date Wed, 17 Oct 2018 07:38:00 GMT
Hitesh Sharma created TEZ-4010:
----------------------------------

             Summary: Use InputReadyVertexManager for broadcast connection
                 Key: TEZ-4010
                 URL: https://issues.apache.org/jira/browse/TEZ-4010
             Project: Apache Tez
          Issue Type: Improvement
            Reporter: Hitesh Sharma


As per [VertexImpl::assignVertexManager|https://github.com/apache/tez/blob/39d76a656216d4843908279ef8eaa29a4cc83104/tez-dag/src/main/java/org/apache/tez/dag/app/dag/impl/VertexImpl.java#L2677]
an ImmediateStartVertexManager is used for broadcast connections. This seems to be inefficient
as tasks are started way before they can run in the DAG.

Thoughts on using InputReadyVertexManager for broadcast connections?



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message