mahout-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sean Owen <sro...@gmail.com>
Subject Re: mapreduce memory issues
Date Thu, 06 May 2010 13:07:51 GMT
(I committed my proper fix BTW.)

The job itself doesn't override these values. If they're not what you
set, then Hadoop is changing them. I am not entirely familiar with its
rules, but think it limits or alters the number of workers to fit the
distribution of the input, available cores, etc.

On Thu, May 6, 2010 at 12:22 PM, Tamas Jambor <jamborta@googlemail.com> wrote:
> I set the default values in mapred-site.xml, but when I run the job and
> check the settings there are different values. I could force to use the
> default values, but that's not optimal either in some cases.
>
> On 06/05/2010 11:36, Sean Owen wrote:
>>
>> Where do you see it setting mappers and reducers? it shouldn't, and
>> doesn't as far as I can see. Hadoop may be overriding your settings.
>>
>

Mime
View raw message