spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Marcelo Vanzin <van...@cloudera.com>
Subject Re: SparkContext & Threading
Date Fri, 05 Jun 2015 19:30:09 GMT
Ignoring the serialization thing (seems like a red herring):

On Fri, Jun 5, 2015 at 11:48 AM, Lee McFadden <spleeman@gmail.com> wrote:

> 15/06/05 11:35:32 WARN TaskSetManager: Lost task 0.0 in stage 0.0 (TID 0,
> localhost): java.lang.NoSuchMethodError:
> org.apache.spark.executor.TaskMetrics.inputMetrics_$eq(Lscala/Option;)V
> at
> com.datastax.spark.connector.metrics.InputMetricsUpdater$.apply(InputMetricsUpdater.scala:61)
> at
> com.datastax.spark.connector.rdd.CassandraTableScanRDD.compute(CassandraTableScanRDD.scala:196)
>

You might be using this Cassandra library with an incompatible version of
Spark; the `TaskMetrics` class has changed in the past, and the method it's
looking for does not exist at least in 1.4.

-- 
Marcelo

Mime
View raw message