hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arun C Murthy (Created) (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-3902) MR AM should reuse containers for map tasks
Date Thu, 23 Feb 2012 15:10:49 GMT
MR AM should reuse containers for map tasks

                 Key: MAPREDUCE-3902
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3902
             Project: Hadoop Map/Reduce
          Issue Type: Improvement
          Components: applicationmaster, mrv2
            Reporter: Arun C Murthy
            Assignee: Arun C Murthy

The MR AM is now in a great position to reuse containers across (map) tasks. This is something
similar to JVM re-use we had in 0.20.x, but in a significantly better manner:
# Consider data-locality when re-using containers
# Consider the new shuffle - ensure that reduces fetch output of the whole container at once
(i.e. all maps) 

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message