spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sourav Chandra <sourav.chan...@livestream.com>
Subject Re: hi
Date Mon, 23 Jun 2014 05:30:19 GMT
Please check what is the spark master url. Set that url while launching
spark-shell

You can get it from the terminal where spark master is running or from
cluster ui. http://<ip/host of the box where master is running>:8080

Thanks,
Sourav


On Mon, Jun 23, 2014 at 10:56 AM, rapelly kartheek <kartheek.mbms@gmail.com>
wrote:

> Hi
>   Can someone help me with the following error that I faced while setting
> up single node spark framework.
>
> karthik@karthik-OptiPlex-9020:~/spark-1.0.0$
> MASTER=spark://localhost:7077 sbin/spark-shell
> bash: sbin/spark-shell: No such file or directory
> karthik@karthik-OptiPlex-9020:~/spark-1.0.0$
> MASTER=spark://localhost:7077 bin/spark-shell
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=128m; support was removed in 8.0
> 14/06/23 10:44:53 INFO spark.SecurityManager: Changing view acls to:
> karthik
> 14/06/23 10:44:53 INFO spark.SecurityManager: SecurityManager:
> authentication disabled; ui acls disabled; users with view permissions:
> Set(karthik)
> 14/06/23 10:44:53 INFO spark.HttpServer: Starting HTTP Server
> 14/06/23 10:44:53 INFO server.Server: jetty-8.y.z-SNAPSHOT
> 14/06/23 10:44:53 INFO server.AbstractConnector: Started
> SocketConnector@0.0.0.0:39588
> Welcome to
>       ____              __
>      / __/__  ___ _____/ /__
>     _\ \/ _ \/ _ `/ __/  '_/
>    /___/ .__/\_,_/_/ /_/\_\   version 1.0.0
>       /_/
>
> Using Scala version 2.10.4 (Java HotSpot(TM) 64-Bit Server VM, Java
> 1.8.0_05)
> Type in expressions to have them evaluated.
> Type :help for more information.
> 14/06/23 10:44:55 INFO spark.SecurityManager: Changing view acls to:
> karthik
> 14/06/23 10:44:55 INFO spark.SecurityManager: SecurityManager:
> authentication disabled; ui acls disabled; users with view permissions:
> Set(karthik)
> 14/06/23 10:44:55 INFO slf4j.Slf4jLogger: Slf4jLogger started
> 14/06/23 10:44:55 INFO Remoting: Starting remoting
> 14/06/23 10:44:55 INFO Remoting: Remoting started; listening on addresses
> :[akka.tcp://spark@karthik-OptiPlex-9020:50294]
> 14/06/23 10:44:55 INFO Remoting: Remoting now listens on addresses:
> [akka.tcp://spark@karthik-OptiPlex-9020:50294]
> 14/06/23 10:44:55 INFO spark.SparkEnv: Registering MapOutputTracker
> 14/06/23 10:44:55 INFO spark.SparkEnv: Registering BlockManagerMaster
> 14/06/23 10:44:55 INFO storage.DiskBlockManager: Created local directory
> at /tmp/spark-local-20140623104455-3297
> 14/06/23 10:44:55 INFO storage.MemoryStore: MemoryStore started with
> capacity 294.6 MB.
> 14/06/23 10:44:55 INFO network.ConnectionManager: Bound socket to port
> 60264 with id = ConnectionManagerId(karthik-OptiPlex-9020,60264)
> 14/06/23 10:44:55 INFO storage.BlockManagerMaster: Trying to register
> BlockManager
> 14/06/23 10:44:55 INFO storage.BlockManagerInfo: Registering block manager
> karthik-OptiPlex-9020:60264 with 294.6 MB RAM
> 14/06/23 10:44:55 INFO storage.BlockManagerMaster: Registered BlockManager
> 14/06/23 10:44:55 INFO spark.HttpServer: Starting HTTP Server
> 14/06/23 10:44:55 INFO server.Server: jetty-8.y.z-SNAPSHOT
> 14/06/23 10:44:55 INFO server.AbstractConnector: Started
> SocketConnector@0.0.0.0:38307
> 14/06/23 10:44:55 INFO broadcast.HttpBroadcast: Broadcast server started
> at http://10.0.1.61:38307
> 14/06/23 10:44:55 INFO spark.HttpFileServer: HTTP File server directory is
> /tmp/spark-082a44f6-e877-48cc-8ab7-1bcbcf8136b0
> 14/06/23 10:44:55 INFO spark.HttpServer: Starting HTTP Server
> 14/06/23 10:44:55 INFO server.Server: jetty-8.y.z-SNAPSHOT
> 14/06/23 10:44:55 INFO server.AbstractConnector: Started
> SocketConnector@0.0.0.0:58745
> 14/06/23 10:44:56 INFO server.Server: jetty-8.y.z-SNAPSHOT
> 14/06/23 10:44:56 INFO server.AbstractConnector: Started
> SelectChannelConnector@0.0.0.0:4040
> 14/06/23 10:44:56 INFO ui.SparkUI: Started SparkUI at
> http://karthik-OptiPlex-9020:4040
> 14/06/23 10:44:56 WARN util.NativeCodeLoader: Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
> 14/06/23 10:44:56 INFO client.AppClient$ClientActor: Connecting to master
> spark://localhost:7077...
> 14/06/23 10:44:56 INFO repl.SparkILoop: Created spark context..
> 14/06/23 10:44:56 WARN client.AppClient$ClientActor: Could not connect to
> akka.tcp://sparkMaster@localhost:7077:
> akka.remote.EndpointAssociationException: Association failed with
> [akka.tcp://sparkMaster@localhost:7077]
> Spark context available as sc.
>
> scala> 14/06/23 10:44:56 WARN client.AppClient$ClientActor: Could not
> connect to akka.tcp://sparkMaster@localhost:7077:
> akka.remote.EndpointAssociationException: Association failed with
> [akka.tcp://sparkMaster@localhost:7077]
> 14/06/23 10:44:56 WARN client.AppClient$ClientActor: Could not connect to
> akka.tcp://sparkMaster@localhost:7077:
> akka.remote.EndpointAssociationException: Association failed with
> [akka.tcp://sparkMaster@localhost:7077]
> 14/06/23 10:44:56 WARN client.AppClient$ClientActor: Could not connect to
> akka.tcp://sparkMaster@localhost:7077:
> akka.remote.EndpointAssociationException: Association failed with
> [akka.tcp://sparkMaster@localhost:7077]
> 14/06/23 10:45:16 INFO client.AppClient$ClientActor: Connecting to master
> spark://localhost:7077...
> 14/06/23 10:45:16 WARN client.AppClient$ClientActor: Could not connect to
> akka.tcp://sparkMaster@localhost:7077:
> akka.remote.EndpointAssociationException: Association failed with
> [akka.tcp://sparkMaster@localhost:7077]
> 14/06/23 10:45:16 WARN client.AppClient$ClientActor: Could not connect to
> akka.tcp://sparkMaster@localhost:7077:
> akka.remote.EndpointAssociationException: Association failed with
> [akka.tcp://sparkMaster@localhost:7077]
> 14/06/23 10:45:16 WARN client.AppClient$ClientActor: Could not connect to
> akka.tcp://sparkMaster@localhost:7077:
> akka.remote.EndpointAssociationException: Association failed with
> [akka.tcp://sparkMaster@localhost:7077]
> 14/06/23 10:45:16 WARN client.AppClient$ClientActor: Could not connect to
> akka.tcp://sparkMaster@localhost:7077:
> akka.remote.EndpointAssociationException: Association failed with
> [akka.tcp://sparkMaster@localhost:7077]
> 14/06/23 10:45:36 INFO client.AppClient$ClientActor: Connecting to master
> spark://localhost:7077...
> 14/06/23 10:45:36 WARN client.AppClient$ClientActor: Could not connect to
> akka.tcp://sparkMaster@localhost:7077:
> akka.remote.EndpointAssociationException: Association failed with
> [akka.tcp://sparkMaster@localhost:7077]
> 14/06/23 10:45:36 WARN client.AppClient$ClientActor: Could not connect to
> akka.tcp://sparkMaster@localhost:7077:
> akka.remote.EndpointAssociationException: Association failed with
> [akka.tcp://sparkMaster@localhost:7077]
> 14/06/23 10:45:36 WARN client.AppClient$ClientActor: Could not connect to
> akka.tcp://sparkMaster@localhost:7077:
> akka.remote.EndpointAssociationException: Association failed with
> [akka.tcp://sparkMaster@localhost:7077]
> 14/06/23 10:45:36 WARN client.AppClient$ClientActor: Could not connect to
> akka.tcp://sparkMaster@localhost:7077:
> akka.remote.EndpointAssociationException: Association failed with
> [akka.tcp://sparkMaster@localhost:7077]
>
>
>
>  Thanks in advance!!!
>



-- 

Sourav Chandra

Senior Software Engineer

· · · · · · · · · · · · · · · · · · · · · · · · · · · · · ·
· · ·

sourav.chandra@livestream.com

o: +91 80 4121 8723

m: +91 988 699 3746

skype: sourav.chandra

Livestream

"Ajmera Summit", First Floor, #3/D, 68 Ward, 3rd Cross, 7th C Main, 3rd
Block, Koramangala Industrial Area,

Bangalore 560034

www.livestream.com

Mime
View raw message