spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Moshe Beeri <moshe.be...@gmail.com>
Subject Re: Fails to run simple Spark (Hello World) scala program
Date Sat, 20 Sep 2014 08:57:21 GMT
Hi Nanu/All

Now I interfacing an other strange (relatively to new complex framework)
error.
I run ./sbin/start-all.sh (my computer name after John nash) and got the
connection Connecting to master spark://nash:7077
running on my local machine yields
java.lang.ClassNotFoundException: com.example.scamel.Nizoz$$anonfun$3

But the class com.example.scamel.Nizoz (in fact Scala object) is the one
under debugging.

  def main(args: Array[String]) {
    println(scala.tools.nsc.Properties.versionString)
    try {
      //Nizoz.connect
      val logFile =
"/home/moshe/store/frameworks/spark-1.1.0-bin-hadoop1/README.md" // Should
be some file on your system
      val conf = new SparkConf().setAppName("spark
town").setMaster("spark://nash:7077"); //spark://master:7077
      val sc = new SparkContext(conf)
      val logData = sc.textFile(logFile, 2).cache()
      *val numAs = logData.filter(line => line.contains("a")).count()    //
<- here is  where the exception thrown *

Any help will be welcome





תודה רבה,
משה בארי.
054-3133943
Email <moshe.beeri@gmail.com> | linkedin <http://www.linkedin.com/in/mobee>



On Sat, Sep 20, 2014 at 11:22 AM, Moshe Beeri <moshe.beeri@gmail.com> wrote:

> Thank Manu,
>
> I just saw I have included hadoop client 2.x in my pom.xml, removing it
> solved the problem.
>
> Thanks for you help
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Fails-to-run-simple-Spark-Hello-World-scala-program-tp14718p14721.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
>

Mime
View raw message