mrunit-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jason E Tedor (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (MRUNIT-205) Add support for MultipleInput
Date Tue, 08 Apr 2014 01:33:15 GMT

    [ https://issues.apache.org/jira/browse/MRUNIT-205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13962490#comment-13962490
] 

Jason E Tedor edited comment on MRUNIT-205 at 4/8/14 1:32 AM:
--------------------------------------------------------------

Attached is a patch that adds support for testing jobs that have multiple input sources (i.e.,
jobs that would use {{MultipleInputs}} in their job configuration).

The patch includes a slight refactoring of already-existing classes to enable reuse.

The main contribution is {{org.apache.hadoop.mrunit.MultipleInputMapReduceDriver}} (old API)
and {{org.apache.hadoop.mrunit.mapreduce.MultipleInputMapReduceDriver}} (new API). I have
included multiple input versions of all of the unit tests in {{org.apache.hadoop.mrunit.TestMapReduceDriver}}
and {{org.apache.hadoop.mrunit.mapreduce.TestMapReduceDriver}}, respectively.

Please let me know your thoughts.


was (Author: jasonetedor):
Attached is a patch that adds support for testing jobs that have multiple input sources (i.e.,
jobs that would use {{MultipleInputs}} in their job configuration).

> Add support for MultipleInput
> -----------------------------
>
>                 Key: MRUNIT-205
>                 URL: https://issues.apache.org/jira/browse/MRUNIT-205
>             Project: MRUnit
>          Issue Type: New Feature
>            Reporter: Jason E Tedor
>         Attachments: MRUNIT-205.patch
>
>
> Some MapReduce jobs have multiple input sources that can even feed different Mapper implementations
within the same job.
> MRUnit does not have a driver that natively supports testing these types of jobs.
> Note that this is not the same as MRUNIT-64. However, there are comments in that ticket
that adding such support could be a good feature.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message