hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ming Ma (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-5835) Killing Task might cause the job to go to ERROR state
Date Mon, 14 Apr 2014 15:40:14 GMT
Ming Ma created MAPREDUCE-5835:
----------------------------------

             Summary: Killing Task might cause the job to go to ERROR state
                 Key: MAPREDUCE-5835
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5835
             Project: Hadoop Map/Reduce
          Issue Type: Bug
            Reporter: Ming Ma
            Assignee: Ming Ma


There could be a race condition if job is killed right after task attempt receives TA_DONE
event. In that case, TaskImpl might receive T_ATTEMPT_SUCCEEDED followed by T_ATTEMPTED_KILLED
for the same attempt, thus transition job to ERROR state.

a. The task is in KILL_WAIT.
b. TA receives TA_DONE event.
c. Before TA transitions to SUCCEEDED state, Task sends TA_KILL event.
d. TA transitions to SUCCEEDED state and thus send T_ATTEMPT_SUCCEEDED to the task. The task
transitions to KILLED state.
e. TA processes TA_KILL event and sends T_ATTEMPT_KILLED to the task.
f. When task is in KILLED state, it can't handle T_ATTEMPT_KILLED event, thus transition job
to ERROR state.




--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message