spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Christophe Billiard <>
Subject In Spark Streaming on Mesos (using ssc.actorStream)
Date Wed, 07 Jan 2015 13:30:56 GMT
Hi all,

I am trying to run this example on mesos:

I have mesos 0.21.0 (instead of 0.18.1, could that be a problem?)
I download spark pre built package spark-1.2.0-bin-hadoop2.4.tgz untar it
Create the conf/ file with the following lines:
export MESOS_NATIVE_LIBRARY=/usr/local/lib/

I create and fill the build.sbt (spark 1.2.0 / scala 2.11.4)
and I am using the src/main/scala/StreamingApp.scala (of the spark
activator) as my main class in Spark

When I submit with .setMaster("local[*]")
The helloer actor is started at
and it works fine.

But when I submit with .setMaster("mesos://")
The helloer actor is started at
and I get the following log:
Exception in thread "main" Actor not found for:
ActorSelection[Anchor(akka://sparkDriver/), Path(/user/Supervisor0/helloer)]

The problem is probably the new path of my actor
It can't be reached by the following url anymore (since its path is
akka://sparkExecutor/user/Supervisor0/helloer) :
val url =

I have tried many systemActor@host:port but I didn't manage to communicate
with my actor

How can I reach my actor?
Can the mesos 0.21.0 be the source of my problem?
Have I misconfigured anything?
Any ideas?

View this message in context:
Sent from the Apache Spark User List mailing list archive at

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message