spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Adrian Mocanu <amoc...@verticalscope.com>
Subject RE: Exception: NoSuchMethodError: org.apache.spark.streaming.StreamingContext$.toPairDStreamFunctions
Date Thu, 22 Jan 2015 20:47:22 GMT
I use spark 1.1.0-SNAPSHOT

val spark="org.apache.spark" %% "spark-core" % "1.1.0-SNAPSHOT" % "provided" excludeAll(
-----Original Message-----
From: Sean Owen [mailto:sowen@cloudera.com] 
Sent: January-22-15 11:39 AM
To: Adrian Mocanu
Cc: user@spark.incubator.apache.org
Subject: Re: Exception: NoSuchMethodError: org.apache.spark.streaming.StreamingContext$.toPairDStreamFunctions

NoSuchMethodError almost always means that you have compiled some code against one version
of a library but are running against another. I wonder if you are including different versions
of Spark in your project, or running against a cluster on an older version?

On Thu, Jan 22, 2015 at 3:57 PM, Adrian Mocanu <amocanu@verticalscope.com> wrote:
> Hi
>
> I get this exception when I run a Spark test case on my local machine:
>
>
>
> An exception or error caused a run to abort:
> org.apache.spark.streaming.StreamingContext$.toPairDStreamFunctions(Lo
> rg/apache/spark/streaming/dstream/DStream;Lscala/reflect/ClassTag;Lsca
> la/reflect/ClassTag;Lscala/math/Ordering;)Lorg/apache/spark/streaming/
> dstream/PairDStreamFunctions;
>
> java.lang.NoSuchMethodError:
> org.apache.spark.streaming.StreamingContext$.toPairDStreamFunctions(Lo
> rg/apache/spark/streaming/dstream/DStream;Lscala/reflect/ClassTag;Lsca
> la/reflect/ClassTag;Lscala/math/Ordering;)Lorg/apache/spark/streaming/
> dstream/PairDStreamFunctions;
>
>
>
> In my test case I have these Spark related imports imports:
>
> import org.apache.spark.streaming.StreamingContext._
>
> import org.apache.spark.streaming.TestSuiteBase
>
> import org.apache.spark.streaming.dstream.DStream
>
> import 
> org.apache.spark.streaming.StreamingContext.toPairDStreamFunctions
>
>
>
> -Adrian
>
>
Mime
View raw message