tez-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jason Lowe (JIRA)" <j...@apache.org>
Subject [jira] [Created] (TEZ-2972) Ability for Tez AM to ignore node updates from YARN
Date Fri, 04 Dec 2015 16:44:10 GMT
Jason Lowe created TEZ-2972:
-------------------------------

             Summary: Ability for Tez AM to ignore node updates from YARN
                 Key: TEZ-2972
                 URL: https://issues.apache.org/jira/browse/TEZ-2972
             Project: Apache Tez
          Issue Type: Improvement
            Reporter: Jason Lowe


This is similar to MAPREDUCE-6119.  Sometimes reacting to a node update event can cause more
harm than good.  For example, an UNHEALTHY node may be able to shuffle just fine.  Therefore
obsoleting the output of tasks that ran on that node and re-running them simply adds more
overhead to the job with no benefit.  It would be nice to be able to configure Tez to ignore
node update events if desired.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message