mahout-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mark <static.void....@gmail.com>
Subject Re: Max JobConf exceeded
Date Tue, 08 Mar 2011 01:05:25 GMT
Just realized this is specific to the Cloudera distribution (CDH3).

I had to set the mapred.user.jobconf.limit configuration

On 3/7/11 3:45 PM, Sean Owen wrote:
> Does anyone know of why PFPGrowth might put something huge into the
> Hadoop config object? I don't see anything obvious by glancing.
>
> On Mon, Mar 7, 2011 at 10:00 PM, Mark<static.void.dev@gmail.com>  wrote:
>> Its when the 2nd job starts...
>> org.apache.mahout.fpm.pfpgrowth.PFPGrowth.startTransactionSorting(PFPGrowth.java:345)
>>     at
>> org.apache.mahout.fpm.pfpgrowth.PFPGrowth.runPFPGrowth(PFPGrowth.java:198)
>>     at
>> org.apache.mahout.fpm.pfpgrowth.FPGrowthDriver.main(FPGrowthDriver.java:166)
>>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>     at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>     at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>     at java.lang.reflect.Method.invoke(Method.java:597)
>>     at org.apache.hadoop.util.RunJar.main(RunJar.java:186)
>>

Mime
View raw message