tez-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yingda Chen (JIRA)" <j...@apache.org>
Subject [jira] [Created] (TEZ-4062) Speculative attempt scheduling should be aborted when Task has complelted
Date Thu, 18 Apr 2019 22:03:00 GMT
Yingda Chen created TEZ-4062:
--------------------------------

             Summary: Speculative attempt scheduling should be aborted when Task has complelted
                 Key: TEZ-4062
                 URL: https://issues.apache.org/jira/browse/TEZ-4062
             Project: Apache Tez
          Issue Type: Bug
            Reporter: Yingda Chen


In RedundantScheduleTransition (inside TaskImpl), we try to find the oldest running attempt
and use it as the causual attempt when doing "addAndScheduleAttempt".

 

However, the task may have completed at this moment, i.e., the task attempt that was considered
running and long-tailed by speculator is now completed. In this case, we may not be able to
find any unfinished attempt, which will lead to NPE in following logic (even without NPE,
it still makes no sense to proceed with scheduling speculative attempt anyway)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message