hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Akira AJISAKA (JIRA)" <j...@apache.org>
Subject [jira] [Created] (MAPREDUCE-5906) Inconsistent configuration in property "mapreduce.reduce.shuffle.input.buffer.percent"
Date Tue, 27 May 2014 08:51:01 GMT
Akira AJISAKA created MAPREDUCE-5906:
----------------------------------------

             Summary: Inconsistent configuration in property "mapreduce.reduce.shuffle.input.buffer.percent"
                 Key: MAPREDUCE-5906
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5906
             Project: Hadoop Map/Reduce
          Issue Type: Improvement
            Reporter: Akira AJISAKA
            Assignee: Akira AJISAKA
            Priority: Minor


In MergeManagerImpl.java, the default value of MRJobConfig.SHUFFLE_INPUT_BUFFER_PERCENT (=mapreduce.reduce.shuffle.input.buffer.percent)
looks 0.90.
{code}
  final float maxInMemCopyUse =
    jobConf.getFloat(MRJobConfig.SHUFFLE_INPUT_BUFFER_PERCENT, 0.90f);
{code}
However, the actual default value is 0.70 in mapred-default.xml.
{code}
  <name>mapreduce.reduce.shuffle.input.buffer.percent</name>
  <value>0.70</value>
{code}



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message