spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sean Owen <so...@cloudera.com>
Subject Re: Exception: NoSuchMethodError: org.apache.spark.streaming.StreamingContext$.toPairDStreamFunctions
Date Thu, 22 Jan 2015 16:39:16 GMT
NoSuchMethodError almost always means that you have compiled some code
against one version of a library but are running against another. I
wonder if you are including different versions of Spark in your
project, or running against a cluster on an older version?

On Thu, Jan 22, 2015 at 3:57 PM, Adrian Mocanu
<amocanu@verticalscope.com> wrote:
> Hi
>
> I get this exception when I run a Spark test case on my local machine:
>
>
>
> An exception or error caused a run to abort:
> org.apache.spark.streaming.StreamingContext$.toPairDStreamFunctions(Lorg/apache/spark/streaming/dstream/DStream;Lscala/reflect/ClassTag;Lscala/reflect/ClassTag;Lscala/math/Ordering;)Lorg/apache/spark/streaming/dstream/PairDStreamFunctions;
>
> java.lang.NoSuchMethodError:
> org.apache.spark.streaming.StreamingContext$.toPairDStreamFunctions(Lorg/apache/spark/streaming/dstream/DStream;Lscala/reflect/ClassTag;Lscala/reflect/ClassTag;Lscala/math/Ordering;)Lorg/apache/spark/streaming/dstream/PairDStreamFunctions;
>
>
>
> In my test case I have these Spark related imports imports:
>
> import org.apache.spark.streaming.StreamingContext._
>
> import org.apache.spark.streaming.TestSuiteBase
>
> import org.apache.spark.streaming.dstream.DStream
>
> import org.apache.spark.streaming.StreamingContext.toPairDStreamFunctions
>
>
>
> -Adrian
>
>

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org


Mime
View raw message