hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Akira AJISAKA (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-5906) Inconsistent configuration in property "mapreduce.reduce.shuffle.input.buffer.percent"
Date Tue, 27 May 2014 08:51:01 GMT
Akira AJISAKA created MAPREDUCE-5906:

             Summary: Inconsistent configuration in property "mapreduce.reduce.shuffle.input.buffer.percent"
                 Key: MAPREDUCE-5906
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5906
             Project: Hadoop Map/Reduce
          Issue Type: Improvement
            Reporter: Akira AJISAKA
            Assignee: Akira AJISAKA
            Priority: Minor

In MergeManagerImpl.java, the default value of MRJobConfig.SHUFFLE_INPUT_BUFFER_PERCENT (=mapreduce.reduce.shuffle.input.buffer.percent)
looks 0.90.
  final float maxInMemCopyUse =
    jobConf.getFloat(MRJobConfig.SHUFFLE_INPUT_BUFFER_PERCENT, 0.90f);
However, the actual default value is 0.70 in mapred-default.xml.

This message was sent by Atlassian JIRA

View raw message