spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Koert Kuipers <ko...@tresata.com>
Subject spark-shell breaks for scala 2.11 (with yarn)?
Date Wed, 06 May 2015 19:05:46 GMT
hello all,
i build spark 1.3.1 (for cdh 5.3 with yarn) twice: for scala 2.10 and scala
2.11. i am running on a secure cluster. the deployment configs are
identical.

i can launch jobs just fine on both the scala 2.10 and scala 2.11 versions.

spark-shell works on the scala 2.10 version, but not on the scala 2.11
version. this is what i get:

$ /usr/local/lib/spark-1.3.1-cdh5.3-scala2.11/bin/spark-shell
15/05/06 14:58:49 WARN NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
15/05/06 14:58:49 INFO SecurityManager: Changing view acls to: koert
15/05/06 14:58:49 INFO SecurityManager: Changing modify acls to: koert
15/05/06 14:58:49 INFO SecurityManager: SecurityManager: authentication
disabled; ui acls disabled; users with view permissions: Set(koert); users
with modify permissions: Set(koert)
15/05/06 14:58:50 INFO HttpServer: Starting HTTP Server
15/05/06 14:58:50 INFO Server: jetty-8.y.z-SNAPSHOT
15/05/06 14:58:50 INFO AbstractConnector: Started
SocketConnector@0.0.0.0:36413
15/05/06 14:58:50 INFO Utils: Successfully started service 'HTTP server' on
port 36413.
Exception in thread "main" java.util.concurrent.TimeoutException: Futures
timed out after [10 seconds]
    at scala.concurrent.impl.Promise$DefaultPromise.ready(Promise.scala:219)
    at scala.concurrent.impl.Promise$DefaultPromise.ready(Promise.scala:153)
    at scala.concurrent.Await$$anonfun$ready$1.apply(package.scala:95)
    at scala.concurrent.Await$$anonfun$ready$1.apply(package.scala:95)
    at
scala.concurrent.BlockContext$DefaultBlockContext$.blockOn(BlockContext.scala:53)
    at scala.concurrent.Await$.ready(package.scala:95)
    at
scala.tools.nsc.interpreter.SparkILoop$$anonfun$process$1.apply$mcZ$sp(SparkILoop.scala:907)
    at
scala.tools.nsc.interpreter.SparkILoop$$anonfun$process$1.apply(SparkILoop.scala:895)
    at
scala.tools.nsc.interpreter.SparkILoop$$anonfun$process$1.apply(SparkILoop.scala:895)
    at
scala.reflect.internal.util.ScalaClassLoader$.savingContextLoader(ScalaClassLoader.scala:95)
    at scala.tools.nsc.interpreter.SparkILoop.process(SparkILoop.scala:895)
    at org.apache.spark.repl.Main$.main(Main.scala:46)
    at org.apache.spark.repl.Main.main(Main.scala)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at
org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:569)
    at
org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:166)
    at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:189)
    at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:110)
    at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)

Mime
View raw message