tez-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jason Lowe (JIRA)" <j...@apache.org>
Subject [jira] [Created] (TEZ-3770) DAG-aware YARN task scheduler
Date Thu, 22 Jun 2017 16:10:00 GMT
Jason Lowe created TEZ-3770:

             Summary: DAG-aware YARN task scheduler
                 Key: TEZ-3770
                 URL: https://issues.apache.org/jira/browse/TEZ-3770
             Project: Apache Tez
          Issue Type: New Feature
            Reporter: Jason Lowe
            Assignee: Jason Lowe

There are cases where priority alone does not convey the relationship between tasks, and this
can cause problems when scheduling or preempting tasks.  If the YARN task scheduler was aware
of the relationship between tasks then it could make smarter decisions when trying to assign
tasks to containers or preempt running tasks to schedule pending tasks.

This message was sent by Atlassian JIRA

View raw message