spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Akhil Das <ak...@sigmoidanalytics.com>
Subject Re: hi
Date Mon, 23 Jun 2014 05:50:55 GMT
Open your webUI in the browser and see the spark url in the top left corner
of the page and use it while starting your spark shell instead of
localhost:7077.

Thanks
Best Regards


On Mon, Jun 23, 2014 at 10:56 AM, rapelly kartheek <kartheek.mbms@gmail.com>
wrote:

> Hi
>   Can someone help me with the following error that I faced while setting
> up single node spark framework.
>
> karthik@karthik-OptiPlex-9020:~/spark-1.0.0$
> MASTER=spark://localhost:7077 sbin/spark-shell
> bash: sbin/spark-shell: No such file or directory
> karthik@karthik-OptiPlex-9020:~/spark-1.0.0$
> MASTER=spark://localhost:7077 bin/spark-shell
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=128m; support was removed in 8.0
> 14/06/23 10:44:53 INFO spark.SecurityManager: Changing view acls to:
> karthik
> 14/06/23 10:44:53 INFO spark.SecurityManager: SecurityManager:
> authentication disabled; ui acls disabled; users with view permissions:
> Set(karthik)
> 14/06/23 10:44:53 INFO spark.HttpServer: Starting HTTP Server
> 14/06/23 10:44:53 INFO server.Server: jetty-8.y.z-SNAPSHOT
> 14/06/23 10:44:53 INFO server.AbstractConnector: Started
> SocketConnector@0.0.0.0:39588
> Welcome to
>       ____              __
>      / __/__  ___ _____/ /__
>     _\ \/ _ \/ _ `/ __/  '_/
>    /___/ .__/\_,_/_/ /_/\_\   version 1.0.0
>       /_/
>
> Using Scala version 2.10.4 (Java HotSpot(TM) 64-Bit Server VM, Java
> 1.8.0_05)
> Type in expressions to have them evaluated.
> Type :help for more information.
> 14/06/23 10:44:55 INFO spark.SecurityManager: Changing view acls to:
> karthik
> 14/06/23 10:44:55 INFO spark.SecurityManager: SecurityManager:
> authentication disabled; ui acls disabled; users with view permissions:
> Set(karthik)
> 14/06/23 10:44:55 INFO slf4j.Slf4jLogger: Slf4jLogger started
> 14/06/23 10:44:55 INFO Remoting: Starting remoting
> 14/06/23 10:44:55 INFO Remoting: Remoting started; listening on addresses
> :[akka.tcp://spark@karthik-OptiPlex-9020:50294]
> 14/06/23 10:44:55 INFO Remoting: Remoting now listens on addresses:
> [akka.tcp://spark@karthik-OptiPlex-9020:50294]
> 14/06/23 10:44:55 INFO spark.SparkEnv: Registering MapOutputTracker
> 14/06/23 10:44:55 INFO spark.SparkEnv: Registering BlockManagerMaster
> 14/06/23 10:44:55 INFO storage.DiskBlockManager: Created local directory
> at /tmp/spark-local-20140623104455-3297
> 14/06/23 10:44:55 INFO storage.MemoryStore: MemoryStore started with
> capacity 294.6 MB.
> 14/06/23 10:44:55 INFO network.ConnectionManager: Bound socket to port
> 60264 with id = ConnectionManagerId(karthik-OptiPlex-9020,60264)
> 14/06/23 10:44:55 INFO storage.BlockManagerMaster: Trying to register
> BlockManager
> 14/06/23 10:44:55 INFO storage.BlockManagerInfo: Registering block manager
> karthik-OptiPlex-9020:60264 with 294.6 MB RAM
> 14/06/23 10:44:55 INFO storage.BlockManagerMaster: Registered BlockManager
> 14/06/23 10:44:55 INFO spark.HttpServer: Starting HTTP Server
> 14/06/23 10:44:55 INFO server.Server: jetty-8.y.z-SNAPSHOT
> 14/06/23 10:44:55 INFO server.AbstractConnector: Started
> SocketConnector@0.0.0.0:38307
> 14/06/23 10:44:55 INFO broadcast.HttpBroadcast: Broadcast server started
> at http://10.0.1.61:38307
> 14/06/23 10:44:55 INFO spark.HttpFileServer: HTTP File server directory is
> /tmp/spark-082a44f6-e877-48cc-8ab7-1bcbcf8136b0
> 14/06/23 10:44:55 INFO spark.HttpServer: Starting HTTP Server
> 14/06/23 10:44:55 INFO server.Server: jetty-8.y.z-SNAPSHOT
> 14/06/23 10:44:55 INFO server.AbstractConnector: Started
> SocketConnector@0.0.0.0:58745
> 14/06/23 10:44:56 INFO server.Server: jetty-8.y.z-SNAPSHOT
> 14/06/23 10:44:56 INFO server.AbstractConnector: Started
> SelectChannelConnector@0.0.0.0:4040
> 14/06/23 10:44:56 INFO ui.SparkUI: Started SparkUI at
> http://karthik-OptiPlex-9020:4040
> 14/06/23 10:44:56 WARN util.NativeCodeLoader: Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
> 14/06/23 10:44:56 INFO client.AppClient$ClientActor: Connecting to master
> spark://localhost:7077...
> 14/06/23 10:44:56 INFO repl.SparkILoop: Created spark context..
> 14/06/23 10:44:56 WARN client.AppClient$ClientActor: Could not connect to
> akka.tcp://sparkMaster@localhost:7077:
> akka.remote.EndpointAssociationException: Association failed with
> [akka.tcp://sparkMaster@localhost:7077]
> Spark context available as sc.
>
> scala> 14/06/23 10:44:56 WARN client.AppClient$ClientActor: Could not
> connect to akka.tcp://sparkMaster@localhost:7077:
> akka.remote.EndpointAssociationException: Association failed with
> [akka.tcp://sparkMaster@localhost:7077]
> 14/06/23 10:44:56 WARN client.AppClient$ClientActor: Could not connect to
> akka.tcp://sparkMaster@localhost:7077:
> akka.remote.EndpointAssociationException: Association failed with
> [akka.tcp://sparkMaster@localhost:7077]
> 14/06/23 10:44:56 WARN client.AppClient$ClientActor: Could not connect to
> akka.tcp://sparkMaster@localhost:7077:
> akka.remote.EndpointAssociationException: Association failed with
> [akka.tcp://sparkMaster@localhost:7077]
> 14/06/23 10:45:16 INFO client.AppClient$ClientActor: Connecting to master
> spark://localhost:7077...
> 14/06/23 10:45:16 WARN client.AppClient$ClientActor: Could not connect to
> akka.tcp://sparkMaster@localhost:7077:
> akka.remote.EndpointAssociationException: Association failed with
> [akka.tcp://sparkMaster@localhost:7077]
> 14/06/23 10:45:16 WARN client.AppClient$ClientActor: Could not connect to
> akka.tcp://sparkMaster@localhost:7077:
> akka.remote.EndpointAssociationException: Association failed with
> [akka.tcp://sparkMaster@localhost:7077]
> 14/06/23 10:45:16 WARN client.AppClient$ClientActor: Could not connect to
> akka.tcp://sparkMaster@localhost:7077:
> akka.remote.EndpointAssociationException: Association failed with
> [akka.tcp://sparkMaster@localhost:7077]
> 14/06/23 10:45:16 WARN client.AppClient$ClientActor: Could not connect to
> akka.tcp://sparkMaster@localhost:7077:
> akka.remote.EndpointAssociationException: Association failed with
> [akka.tcp://sparkMaster@localhost:7077]
> 14/06/23 10:45:36 INFO client.AppClient$ClientActor: Connecting to master
> spark://localhost:7077...
> 14/06/23 10:45:36 WARN client.AppClient$ClientActor: Could not connect to
> akka.tcp://sparkMaster@localhost:7077:
> akka.remote.EndpointAssociationException: Association failed with
> [akka.tcp://sparkMaster@localhost:7077]
> 14/06/23 10:45:36 WARN client.AppClient$ClientActor: Could not connect to
> akka.tcp://sparkMaster@localhost:7077:
> akka.remote.EndpointAssociationException: Association failed with
> [akka.tcp://sparkMaster@localhost:7077]
> 14/06/23 10:45:36 WARN client.AppClient$ClientActor: Could not connect to
> akka.tcp://sparkMaster@localhost:7077:
> akka.remote.EndpointAssociationException: Association failed with
> [akka.tcp://sparkMaster@localhost:7077]
> 14/06/23 10:45:36 WARN client.AppClient$ClientActor: Could not connect to
> akka.tcp://sparkMaster@localhost:7077:
> akka.remote.EndpointAssociationException: Association failed with
> [akka.tcp://sparkMaster@localhost:7077]
>
>
>
>  Thanks in advance!!!
>

Mime
View raw message