hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Todd Lipcon (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-6067) native-task: spilled records counter is incorrect
Date Wed, 03 Sep 2014 02:35:51 GMT
Todd Lipcon created MAPREDUCE-6067:

             Summary: native-task: spilled records counter is incorrect
                 Key: MAPREDUCE-6067
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6067
             Project: Hadoop Map/Reduce
          Issue Type: Sub-task
            Reporter: Todd Lipcon

After running a terasort, I see the spilled records counter at 5028651606, which is about
half what I expected to see. Using the non-native collector I see the expected count of 10000000000.
It seems the correct number of records were indeed spilled, because the job's output record
count is correct.

This message was sent by Atlassian JIRA

View raw message