spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Luis Marques <>
Subject NumberFormatException
Date Tue, 30 Jul 2013 16:36:35 GMT
Hi i'm trying to run an application using your system but i'm having a few problems.

The code that i'm trying to deploy is attached. I'm using Spark 0.7.3 and Scala 2.9.2

I'm following your Spark Standalone Mode Guide (

So these are my steps:

-Create the master like this: ./run spark.deploy.master.Master
OUTPUT: 	13/07/30 17:12:02 INFO slf4j.Slf4jEventHandler: Slf4jEventHandler started
			13/07/30 17:12:02 INFO actor.ActorSystemImpl: RemoteServerStarted@akka://
			13/07/30 17:12:02 INFO master.Master: Starting Spark master at spark://
			13/07/30 17:12:02 INFO io.IoWorker: IoWorker thread 'spray-io-worker-0' started
			13/07/30 17:12:02 INFO server.HttpServer: akka://sparkMaster/user/HttpServer started on

-Create a worker like this: ./run spark.deploy.worker.Worker spark://
-c 4
WORKER OUTPUT: 	13/07/30 17:13:07 INFO slf4j.Slf4jEventHandler: Slf4jEventHandler started
					13/07/30 17:13:07 INFO actor.ActorSystemImpl: RemoteServerStarted@akka://
					13/07/30 17:13:07 INFO worker.Worker: Starting Spark worker
with 4 cores, 15.0 GB RAM
					13/07/30 17:13:07 INFO worker.Worker: Spark home: /Users/lfmarques/Documents/spark-0.7.3
					13/07/30 17:13:07 INFO worker.Worker: Connecting to master spark://
					13/07/30 17:13:07 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://
					13/07/30 17:13:08 INFO io.IoWorker: IoWorker thread 'spray-io-worker-0' started
					13/07/30 17:13:08 INFO server.HttpServer: akka://sparkWorker/user/HttpServer started
on /
					13/07/30 17:13:08 INFO worker.Worker: Successfully registered with master

-Compile my code using Maven: mvm package

-Launch the Job: mvn exec:java -Dexec.mainClass="Main"
OUTPUT (attached RunOutput.txt)

I went to the worker stderr file in the worker folder:
Exception in thread "main" java.lang.NumberFormatException: For input string: "app-20130730172134-0000"
	at java.lang.NumberFormatException.forInputString(
	at java.lang.Integer.parseInt(
	at java.lang.Integer.parseInt(
	at scala.collection.immutable.StringLike$class.toInt(StringLike.scala:231)
	at scala.collection.immutable.StringOps.toInt(StringOps.scala:31)
	at spark.executor.StandaloneExecutorBackend$.main(StandaloneExecutorBackend.scala:99)
	at spark.executor.StandaloneExecutorBackend.main(StandaloneExecutorBackend.scala)

Do you know where is the problem?

View raw message