spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From tvas <>
Subject Re: Optimizing text file parsing, many small files versus few big files
Date Thu, 20 Nov 2014 13:10:47 GMT
Hello Rzykov,

I tried you approach but unfortunately I'm getting an error. What I get is:

[info] Caused by: java.lang.reflect.InvocationTargetException
[info]  at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
[info]  at
[info]  at
[info]  at java.lang.reflect.Constructor.newInstance(
[info]  at
[info]  ... 22 more

[info] Caused by: java.lang.IncompatibleClassChangeError: Found class
org.apache.hadoop.mapreduce.TaskAttemptContext, but interface was expected
[info]  at
[info]  ... 27 more

I saw that you tested with Spark 1.1.0 and but I am forced to use 1.0.2
currently. Perhaps that is the 
source of the error.

View this message in context:
Sent from the Apache Spark User List mailing list archive at

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message