spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Maisnam Ns <maisnam...@gmail.com>
Subject Spark streaming twitter exception
Date Sat, 20 Sep 2014 22:16:30 GMT
HI ,

Can somebody help me with adding library dependencies in  my build.sbt so
that the java.lang.NoClassDefFoundError issue can be resolved.

My sbt (only the dependencies part) ->

 libraryDependencies ++= Seq(
  "org.apache.spark" %% "spark-core" % "1.0.1" ,
  "org.apache.spark" %% "spark-streaming" % "1.0.1" ,
  "org.apache.spark" %% "spark-streaming-twitter" % "1.0.1"
)

The exception , I am getting  ->
Exception in thread "main" java.lang.NoClassDefFoundError:
org/apache/spark/streaming/twitter/TwitterUtils$     at
TwitterApp$.main(TwitterApp.scala:64)
   at TwitterApp.main(TwitterApp.scala)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at org.apache.spark.deploy.SparkSubmit$.launch(SparkSubmit.scala:330)
    at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:75)
    at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)

The command to submit the jar -> bin/spark-submit --class "TwitterApp"
--master local[4] twitterapp-project_2.10-1.0.jar

Thanks in advance.

Regards,
NIranjan

Mime
View raw message