spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Eduardo Berrocal <eberr...@hawk.iit.edu>
Subject Re: java.lang.AbstractMethodError
Date Thu, 03 Oct 2013 21:03:23 GMT
That directory is not present on version 0.8.0 (the one I am using).

However, there are the files for FlatMapFunction in spark 0.8.0:

$ find ./ -name FlatMapFunction*
./assembly/target/scala-2.9.3/cache/assembly/global/assembly/046f8c33ceea082eba335f924f10506f884e593c_dir/org/apache/spark/api/java/function/FlatMapFunction2.class
./assembly/target/scala-2.9.3/cache/assembly/global/assembly/046f8c33ceea082eba335f924f10506f884e593c_dir/org/apache/spark/api/java/function/FlatMapFunction.class
./core/src/main/scala/org/apache/spark/api/java/function/FlatMapFunction2.scala
./core/src/main/scala/org/apache/spark/api/java/function/FlatMapFunction.scala
./core/target/scala-2.9.3/classes/org/apache/spark/api/java/function/FlatMapFunction2.class
./core/target/scala-2.9.3/classes/org/apache/spark/api/java/function/FlatMapFunction.class
./examples/target/scala-2.9.3/cache/examples/global/assembly/046f8c33ceea082eba335f924f10506f884e593c_dir/org/apache/spark/api/java/function/FlatMapFunction2.class
./examples/target/scala-2.9.3/cache/examples/global/assembly/046f8c33ceea082eba335f924f10506f884e593c_dir/org/apache/spark/api/java/function/FlatMapFunction.class

All of the FlatMapFunction.class files have a modification time bigger than
the .java file, which I suspect means that they have been created from the
new version of the java file (all of them!)

Cheers,
Eduardo.


On Thu, Oct 3, 2013 at 3:38 PM, Martin Weindel <martin.weindel@gmail.com>wrote:

>  Hi Eduardo,
>
> if you are using Spark 0.7.3, I remember that I had to replace the class
> file additional at
> spark-0.7.3/core/target/scala-2.9.3/classes/spark/api/java/function/
>
> Martin
>
> Am 03.10.2013 22:35, schrieb Eduardo Berrocal:
>
>  Hi Martin,
>
>  Yes, that is what is seems. However, it is unlikely that is the case,
> because I have all spark classes on my home, which is mounted on NFS to all
> nodes. Unless there is something else I am missing...
>
>  Edu
>
>
> On Thu, Oct 3, 2013 at 3:29 PM, Martin Weindel <martin.weindel@gmail.com>wrote:
>
>>  Hi Eduardo,
>>
>> it seems to me that your second problem is caused by inconsistent, i.e.
>> different classes in master and worker JVMs.
>> Are you sure, that you have replaced the changed FlatMapFunction on all
>> worker nodes and also on master?
>>
>> Regards,
>> Martin
>>
>>  13/10/03 13:27:44 INFO cluster.ClusterTaskSetManager: Lost TID 0 (task
>> 1.0:0)
>> 13/10/03 13:27:44 INFO cluster.ClusterTaskSetManager: Loss was due to
>> java.io.InvalidClassException
>> java.io.InvalidClassException:
>> org.apache.spark.api.java.function.FlatMapFunction; local class
>> incompatible: stream classdesc serialVersionUID = -1748278142466443391,
>> local class serialVersionUID = 2220150375729402137
>>
>>
>>
>
>

Mime
View raw message