mahout-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Robin Anil <robin.a...@gmail.com>
Subject Re: Queueing several Mahout classifier training jobs
Date Fri, 10 Dec 2010 12:13:23 GMT
Do these M/Rs have any conflicting temp, input, output directories. Are
there any errors being thrown. ?


On Fri, Dec 10, 2010 at 4:25 PM, Robin M. E. Swezey <robin@swezey.fr> wrote:

> Hello,
>
> I am currently using Mahout to train and test several CBayes
> classifiers in 10-folds.
>
> I launch all jobs for a 10-fold simultaneously using the mahout
> trainclassifier|testclassifier command in a script. However, when
> looking at the Hadoop job journal after having queued the 10 jobs, it
> appears that all the Bayes Feature Driver jobs, upon completion, exit
> without queueing their respective subsequent jobs (TF-Idf Driver,
> Bayes Weight Summer Driver, Complementary Bayes Theta Normalizer).
>
> This does not happen if I queue only 4 Mahout CBayes classifier
> training jobs in Hadoop, the subsequent TF-Idf jobs etc are queued
> fine.
>
> Do you have any idea of the cause of this behavior? I would really
> like to be able to queue as many Mahout training jobs as possible.
>
> Best regards
>
> --
> Robin M. E. Swezey
> --
> Web/AI PhD Candidate
> --
> +81 (0) 90 1785 1337
> robin@swezey.fr
> http://www-toralab.ics.nitech.ac.jp/
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message