spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Michael Armbrust (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-1347) SHARK error when running in server mode: java.net.BindException: Address already in use
Date Tue, 01 Apr 2014 21:43:14 GMT

    [ https://issues.apache.org/jira/browse/SPARK-1347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13957043#comment-13957043
] 

Michael Armbrust commented on SPARK-1347:
-----------------------------------------

It looks like the the Spark web UI is failing to bind to its port.  Are you running another
copy of Spark on the same machine or is something else listening on 4040?  If so you should
change the port for the web ui by setting "spark.ui.port" in SparkConf.  More details on configuration
can be found here: http://spark.apache.org/docs/0.9.0/configuration.html

> SHARK error when running in server mode: java.net.BindException: Address already in use
> ---------------------------------------------------------------------------------------
>
>                 Key: SPARK-1347
>                 URL: https://issues.apache.org/jira/browse/SPARK-1347
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>    Affects Versions: 0.9.0
>            Reporter: Test
>
> Start spark on cluster machine
> then start the shark in server mode using:
> ./bin/shark --service sharkserver <port>
> Now connect to shark using client as :
> ./bin/shark -h <server-host> -p <server-port>
> Check the hive.log:
> 2014-03-28 10:24:05,391 WARN  component.AbstractLifeCycle (AbstractLifeCycle.java:setFailed(204))
- FAILED org.eclipse.jetty.server.Server@5eb98063: java.net.BindException: Address already
in use
> java.net.BindException: Address already in use
> 	at sun.nio.ch.Net.bind0(Native Method)
> 	at sun.nio.ch.Net.bind(Net.java:444)
> 	at sun.nio.ch.Net.bind(Net.java:436)
> 	at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:214)
> 	at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
> 	at org.eclipse.jetty.server.nio.SelectChannelConnector.open(SelectChannelConnector.java:187)
> 	at org.eclipse.jetty.server.AbstractConnector.doStart(AbstractConnector.java:316)
> 	at org.eclipse.jetty.server.nio.SelectChannelConnector.doStart(SelectChannelConnector.java:265)
> 	at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64)
> 	at org.eclipse.jetty.server.Server.doStart(Server.java:286)
> 	at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64)
> 	at org.apache.spark.ui.JettyUtils$$anonfun$1.apply$mcV$sp(JettyUtils.scala:118)
> 	at org.apache.spark.ui.JettyUtils$$anonfun$1.apply(JettyUtils.scala:118)
> 	at org.apache.spark.ui.JettyUtils$$anonfun$1.apply(JettyUtils.scala:118)
> 	at scala.util.Try$.apply(Try.scala:161)
> 	at org.apache.spark.ui.JettyUtils$.connect$1(JettyUtils.scala:118)
> 	at org.apache.spark.ui.JettyUtils$.startJettyServer(JettyUtils.scala:129)
> 	at org.apache.spark.ui.SparkUI.bind(SparkUI.scala:57)
> 	at org.apache.spark.SparkContext.<init>(SparkContext.scala:159)
> 	at shark.SharkContext.<init>(SharkContext.scala:42)
> 	at shark.SharkContext.<init>(SharkContext.scala:61)
> 	at shark.SharkEnv$.initWithSharkContext(SharkEnv.scala:81)
> 	at shark.SharkEnv$.init(SharkEnv.scala:41)
> 	at shark.SharkEnv$.fixUncompatibleConf(SharkEnv.scala:48)
> 	at shark.SharkCliDriver$.main(SharkCliDriver.scala:165)
> 	at shark.SharkCliDriver.main(SharkCliDriver.scala)



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message