hama-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Thomas Jungblut <thomas.jungb...@gmail.com>
Subject Re: Problem with input HDFS paths separated by a comma
Date Sat, 28 Jul 2012 15:22:41 GMT
Hey,

do you have some task logs (they are under
HAMA_DIR/logs/tasklogs/_job_id/..., are there any exceptions?

2012/7/28 Leonidas Fegaras <fegaras@cse.uta.edu>

> Dear fellow Hama users,
> It seems that FileInputFormat.setInputPaths doesn't work correctly for
> multiple HDFS paths (although it works fine in local mode using local
> files). I am using Hama 0.5.0 on Hadoop 1.0.3.
> I am attaching a simple code that concatenates text form files (just to
> show the error).
> It works fine in local mode for multiple files, it works fine in
> pseudo-distributed mode for just one file, but it doesn't work in
> pseudo-distributed mode on multiple HDFS files: it displays the following
> with no entry in the log for this job:
>
> &&& hdfs://localhost:9000/user/**fegaras/orders.tbl,hdfs://**
> localhost:9000/user/fegaras/**customer.tbl
> 12/07/28 09:42:00 INFO bsp.FileInputFormat: Total input paths to process :
> 2
> 12/07/28 09:42:00 INFO bsp.FileInputFormat: Total # of splits: 4
> 12/07/28 09:42:00 INFO bsp.BSPJobClient: Running job: job_201207280900_0004
> 12/07/28 09:42:03 INFO bsp.BSPJobClient: Current supersteps number: 0
> 12/07/28 09:42:03 INFO bsp.BSPJobClient: Job failed.
>
> Both paths are correct and can be accessed separately.
> Is this a Hama error or am I doing something wrong?
> Thanks for your help,
> Best regards
> Leonidas Fegaras
> U. of Texas at Arlington
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message