spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Luis Marques <lfmarqu...@gmail.com>
Subject NumberFormatException
Date Tue, 30 Jul 2013 16:36:35 GMT
Hi i'm trying to run an application using your system but i'm having a few problems.

The code that i'm trying to deploy is attached. I'm using Spark 0.7.3 and Scala 2.9.2

I'm following your Spark Standalone Mode Guide (http://spark-project.org/docs/latest/spark-standalone.html).

So these are my steps:

-Create the master like this: ./run spark.deploy.master.Master
OUTPUT: 	13/07/30 17:12:02 INFO slf4j.Slf4jEventHandler: Slf4jEventHandler started
			13/07/30 17:12:02 INFO actor.ActorSystemImpl: RemoteServerStarted@akka://sparkMaster@10-171-239-168.pdoc.di.fct.unl.pt:7077
			13/07/30 17:12:02 INFO master.Master: Starting Spark master at spark://10-171-239-168.pdoc.di.fct.unl.pt:7077
			13/07/30 17:12:02 INFO io.IoWorker: IoWorker thread 'spray-io-worker-0' started
			13/07/30 17:12:02 INFO server.HttpServer: akka://sparkMaster/user/HttpServer started on
/0.0.0.0:8080

-Create a worker like this: ./run spark.deploy.worker.Worker spark://10-171-239-168.pdoc.di.fct.unl.pt:7077
-c 4
WORKER OUTPUT: 	13/07/30 17:13:07 INFO slf4j.Slf4jEventHandler: Slf4jEventHandler started
					13/07/30 17:13:07 INFO actor.ActorSystemImpl: RemoteServerStarted@akka://sparkWorker@10-171-239-168.pdoc.di.fct.unl.pt:56645
					13/07/30 17:13:07 INFO worker.Worker: Starting Spark worker 10-171-239-168.pdoc.di.fct.unl.pt:56645
with 4 cores, 15.0 GB RAM
					13/07/30 17:13:07 INFO worker.Worker: Spark home: /Users/lfmarques/Documents/spark-0.7.3
					13/07/30 17:13:07 INFO worker.Worker: Connecting to master spark://10-171-239-168.pdoc.di.fct.unl.pt:7077
					13/07/30 17:13:07 INFO actor.ActorSystemImpl: RemoteClientStarted@akka://sparkMaster@10-171-239-168.pdoc.di.fct.unl.pt:7077
					13/07/30 17:13:08 INFO io.IoWorker: IoWorker thread 'spray-io-worker-0' started
					13/07/30 17:13:08 INFO server.HttpServer: akka://sparkWorker/user/HttpServer started
on /0.0.0.0:8081
					13/07/30 17:13:08 INFO worker.Worker: Successfully registered with master

-Compile my code using Maven: mvm package
OUTPUT:  … BUILD SUCCESS …

-Launch the Job: mvn exec:java -Dexec.mainClass="Main"
OUTPUT (attached RunOutput.txt)

I went to the worker stderr file in the worker folder:
Exception in thread "main" java.lang.NumberFormatException: For input string: "app-20130730172134-0000"
	at java.lang.NumberFormatException.forInputString(NumberFormatException.java:48)
	at java.lang.Integer.parseInt(Integer.java:449)
	at java.lang.Integer.parseInt(Integer.java:499)
	at scala.collection.immutable.StringLike$class.toInt(StringLike.scala:231)
	at scala.collection.immutable.StringOps.toInt(StringOps.scala:31)
	at spark.executor.StandaloneExecutorBackend$.main(StandaloneExecutorBackend.scala:99)
	at spark.executor.StandaloneExecutorBackend.main(StandaloneExecutorBackend.scala)

Do you know where is the problem?


Mime
View raw message