mrunit-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Hien Luu <>
Subject Re: Partial Avro MapReduce job
Date Tue, 02 Jul 2013 18:57:01 GMT
Hi Dan,

I think the following setting is needed to solve the issue that you ran into:

                                            <the JSON Avro schema
for you AvroKey>);

I have been trying to find more documentation about the property "avro.serialization.key.writer.schema".


 From: Dan Filimon <>
To:; Hien Luu <> 
Sent: Tuesday, July 2, 2013 9:17 AM
Subject: Re: Partial Avro MapReduce job

Hi Hien!

I saw that answer but it seems like it's for a different kind of exception. Did you really
have the same problem?

On Tue, Jul 2, 2013 at 6:39 PM, Hien Luu <> wrote:

I ran into the same issue and the answer is at
>It would be great if this answer is added to the FAQ of MRUnit or one of the tutorials.
> From: Dan Filimon <>
>Sent: Tuesday, July 2, 2013 7:47 AM
>Subject: Partial Avro MapReduce job
>I've been looking online for a way of testing my job and came across what seemed to be
some promising leads.
>I can't find anything exactly suitable to my case: I'm consuming a custom AvroKey and
outputting IntWritable, VectorWritable from the mapper.
>I'm getting the following error:
>java.lang.IllegalStateException: No applicable class implementing Serialization in conf
at io.serializations for class org.apache.avro.mapred.AvroKey
>And worryingly, .withConfiguration() is now deprecating in MRUnit so [1] doesn't seem
like it's 100% up to date.
>Any ideas?
View raw message