spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Matei Zaharia <matei.zaha...@gmail.com>
Subject Re: NumberFormatException
Date Tue, 30 Jul 2013 21:24:17 GMT
I think the problem is that your pom.xml links against Spark 0.7.2, not 0.7.3. Try using 0.7.3
there too and rebuilding it.

Also, you should ideally be on Scala 2.9.3 for these Spark versions, though it may not matter.

Matei

On Jul 30, 2013, at 9:36 AM, Luis Marques <lfmarques2@gmail.com> wrote:

> Hi i'm trying to run an application using your system but i'm having a few problems.
> 
> The code that i'm trying to deploy is attached. I'm using Spark 0.7.3 and Scala 2.9.2
> 
> I'm following your Spark Standalone Mode Guide (http://spark-project.org/docs/latest/spark-standalone.html).
> 
> So these are my steps:
> 
> -Create the master like this: ./run spark.deploy.master.Master
> OUTPUT: 	13/07/30 17:12:02 INFO slf4j.Slf4jEventHandler: Slf4jEventHandler started
> 			13/07/30 17:12:02 INFO actor.ActorSystemImpl: RemoteServerStarted@akka://sparkMaster@10-171-239-168.pdoc.di.fct.unl.pt:7077
> 			13/07/30 17:12:02 INFO master.Master: Starting Spark master at spark://10-171-239-168.pdoc.di.fct.unl.pt:7077
> 			13/07/30 17:12:02 INFO io.IoWorker: IoWorker thread 'spray-io-worker-0' started
> 			13/07/30 17:12:02 INFO server.HttpServer: akka://sparkMaster/user/HttpServer started
on /0.0.0.0:8080
> 
> -Create a worker like this: ./run spark.deploy.worker.Worker spark://10-171-239-168.pdoc.di.fct.unl.pt:7077
-c 4
> WORKER OUTPUT: 	13/07/30 17:13:07 INFO slf4j.Slf4jEventHandler: Slf4jEventHandler started
> 					13/07/30 17:13:07 INFO actor.ActorSystemImpl: RemoteServerStarted@akka://sparkWorker@10-171-239-168.pdoc.di.fct.unl.pt:56645
> 					13/07/30 17:13:07 INFO worker.Worker: Starting Spark worker 10-171-239-168.pdoc.di.fct.unl.pt:56645
with 4 cores, 15.0 GB RAM
> 					13/07/30 17:13:07 INFO worker.Worker: Spark home: /Users/lfmarques/Documents/spark-0.7.3
> 					13/07/30 17:13:07 INFO worker.Worker: Connecting to master spark://10-171-239-168.pdoc.di.fct.unl.pt:7077
> 					13/07/30 17:13:07 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://sparkMaster@10-171-239-168.pdoc.di.fct.unl.pt:7077
> 					13/07/30 17:13:08 INFO io.IoWorker: IoWorker thread 'spray-io-worker-0' started
> 					13/07/30 17:13:08 INFO server.HttpServer: akka://sparkWorker/user/HttpServer started
on /0.0.0.0:8081
> 					13/07/30 17:13:08 INFO worker.Worker: Successfully registered with master
> 
> -Compile my code using Maven: mvm package
> OUTPUT:  … BUILD SUCCESS …
> 
> -Launch the Job: mvn exec:java -Dexec.mainClass="Main"
> OUTPUT (attached RunOutput.txt)
> 
> I went to the worker stderr file in the worker folder:
> Exception in thread "main" java.lang.NumberFormatException: For input string: "app-20130730172134-0000"
> 	at java.lang.NumberFormatException.forInputString(NumberFormatException.java:48)
> 	at java.lang.Integer.parseInt(Integer.java:449)
> 	at java.lang.Integer.parseInt(Integer.java:499)
> 	at scala.collection.immutable.StringLike$class.toInt(StringLike.scala:231)
> 	at scala.collection.immutable.StringOps.toInt(StringOps.scala:31)
> 	at spark.executor.StandaloneExecutorBackend$.main(StandaloneExecutorBackend.scala:99)
> 	at spark.executor.StandaloneExecutorBackend.main(StandaloneExecutorBackend.scala)
> 
> Do you know where is the problem?
> 
> <RunOutput.txt>
> <SparkTest.zip>


Mime
View raw message