mrunit-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ehsan Haq <ehsan....@klarna.com>
Subject Re: Failing test when using withOutputFormat
Date Thu, 21 Nov 2013 04:26:44 GMT
Thanks for the quick reply.
I am using CDH distribution of Hadoop (2.0.0-mr1-cdh4.3.0).

After looking at the pom of 1.0.0. I realized it is using 2.0.0-alpha.
After changing the version to 2.0.0-alpha in my project the problem is
fixed.

However, I also tried with 2.0.6-alpha (the latest one) and got the same
exception. It seems that the MockMapreduceOutputFormat class makes hard
coded assumption about the input path. Is there a fix for that?

Kind Regards


On Thu, Nov 21, 2013 at 5:06 AM, Brock Noland <brock@cloudera.com> wrote:

> What version of hadoop are you using?
>
>
> On Wednesday, November 20, 2013, Ehsan Haq wrote:
>
>> Hi,
>>    I am writing some unit test for my project which includes testing with
>> a
>> real InputFormat, this feature has been added in 1.0.0. However I am
>> facing
>> a small problem. The real input data is being created in
>> /tmp/mrunit-0.XXXXX/_
>> temporary/_attempt__0000_m_000000_0/part-m-00000
>> instead of being created in something like
>>
>> /tmp/mrunit-0.XXXX/_temporary/0/_temporary/attempt__0000_m_000000_0/part-m-00000
>> which is why I am getting exception
>> org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input Pattern
>> /tmp/mrunit-0.9020799819009947/*/*/*/* matches 0 files
>>
>> I tried to copy the unit tests from the MRUnit 1.0.0 source into my
>> project
>> but still having the same exception.
>> Can anyone help me to trace the problem quickly?
>>
>> Kind Regards
>>
>> --
>> *Muhammad Ehsan ul Haque*
>> Klarna AB
>> Norra Stationsgatan 61
>> SE-113 43 Stockholm
>>
>> Tel: +46 (0)8- 120 120 00
>> Fax: +46 (0)8- 120 120 99
>> Web: www.klarna.com
>>
>
>
> --
> Apache MRUnit - Unit testing MapReduce - http://mrunit.apache.org
>
>


-- 
*Muhammad Ehsan ul Haque*
Klarna AB
Norra Stationsgatan 61
SE-113 43 Stockholm

Tel: +46 (0)8- 120 120 00
Fax: +46 (0)8- 120 120 99
Web: www.klarna.com

Mime
View raw message