hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Adam Kramer (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-2731) Jobtracker should report 99% until the query is done.
Date Wed, 27 Jul 2011 00:05:09 GMT
Jobtracker should report 99% until the query is done.

                 Key: MAPREDUCE-2731
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2731
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: jobtracker
            Reporter: Adam Kramer

Hadoop reporting 100% complete is a lie whenever the job, task, or node is not FULLY complete.
Reports of 100% due to rounding should get explicitly stuck at 99.99% until the job is complete.
The current system gets things stuck at 100%, which is simply wrong.

Even when the true % complete rounds to 100, 100% is still not appropriate to report in the
form of a percentage due to the semantics of percentages.

This bug occurs frequently when a small number of nodes from a task with many nodes are running
very slowly (i.e., the "one overloaded reducer" problem).

This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message