mrunit-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "David Parks" <>
Subject PipelineMapReduceDriver w/ 'mapreduce' api, and testing multiple K,V inputs
Date Fri, 01 Feb 2013 04:59:58 GMT
2 questions:


1)      PipelineMapReduceDriver hasn’t been upgraded to support the
org.apache.hadoop.mapreduce.Mapper/Reducer api has it? Or is that in the


2)      Using just the MapReduceDriver or the MapDriver or ReduceDriver
alone, the tests only run a single key/value through the class, then the
next input fully re-creates the class right? If I’m not wrong in that
statement then this seems like something that can be improved. I just noted
a case where we incorrectly kept state between two different key/value
entries in a map task and the issue could only be reproduced in the cluster.
A better test, it seems, would allow multiple input values and iterate
through them as hadoop really does.  Am I on track here?






From: 周锋 [] 
Sent: Friday, February 01, 2013 10:02 AM
Subject: can't attach mrunit sources jar with "mvn -DdownloadSources=true


can't attach sources jar with "mvn -U -DdownloadSources=true
-DdownloadJavadocs=false eclipse:clean eclipse:eclipse"


need help, thanks!

my dependency is with classifier:

my maven-eclipse-plugin:



my maven 3.0.4 uses maven central repository:|1513871525


my workaround:

download "mrunit-0.9.0-incubating-sources.jar" with classifier "sources",
then rename to "mrunit-0.9.0-incubating-hadoop1-sources.jar"



View raw message