[ https://issues.apache.org/jira/browse/MRUNIT-205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13962490#comment-13962490
]
Jason E Tedor edited comment on MRUNIT-205 at 4/8/14 1:32 AM:
--------------------------------------------------------------
Attached is a patch that adds support for testing jobs that have multiple input sources (i.e.,
jobs that would use {{MultipleInputs}} in their job configuration).
The patch includes a slight refactoring of already-existing classes to enable reuse.
The main contribution is {{org.apache.hadoop.mrunit.MultipleInputMapReduceDriver}} (old API)
and {{org.apache.hadoop.mrunit.mapreduce.MultipleInputMapReduceDriver}} (new API). I have
included multiple input versions of all of the unit tests in {{org.apache.hadoop.mrunit.TestMapReduceDriver}}
and {{org.apache.hadoop.mrunit.mapreduce.TestMapReduceDriver}}, respectively.
Please let me know your thoughts.
was (Author: jasonetedor):
Attached is a patch that adds support for testing jobs that have multiple input sources (i.e.,
jobs that would use {{MultipleInputs}} in their job configuration).
> Add support for MultipleInput
> -----------------------------
>
> Key: MRUNIT-205
> URL: https://issues.apache.org/jira/browse/MRUNIT-205
> Project: MRUnit
> Issue Type: New Feature
> Reporter: Jason E Tedor
> Attachments: MRUNIT-205.patch
>
>
> Some MapReduce jobs have multiple input sources that can even feed different Mapper implementations
within the same job.
> MRUnit does not have a driver that natively supports testing these types of jobs.
> Note that this is not the same as MRUNIT-64. However, there are comments in that ticket
that adding such support could be a good feature.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
|