spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Markus Losoi" <markus.lo...@gmail.com>
Subject Connecting a worker to a master that was bound to the loopback address
Date Tue, 22 Oct 2013 06:17:07 GMT
Hi	

Is it possible to bind a master to the loopback address (127.0.0.1) and then
connect a worker to it by using a public address? (In this case, 'public'
means an address in a WLAN.) I tried this by redirecting incoming connetions
on the public address to the loopback address with "redir" [1]. However, the
worker hangs when I try to connect it to the public address. According to
the log file on the master, the problem seems to be Akka-related. The log
file contains the following lines:

"
13/10/21 12:36:25 ERROR NettyRemoteTransport(null): dropping message
RegisterWorker(worker-20131021153625-192.168.1.147-46479,192.168.1.147,46479
,1,2048,1,8081,192.168.1.147) for non-local recipient
akka://sparkMaster@192.168.1.129:7077/user/Master at
akka://sparkMaster@127.0.0.1:7077 local is akka://sparkMaster@127.0.0.1:7077
",
"
13/10/21 12:36:25 ERROR NettyRemoteTransport(null): dropping message
DaemonMsgWatch(Actor[akka://sparkWorker@192.168.1.147:46479/user/Worker],Act
or[akka://sparkMaster@192.168.1.129:7077/user/Master]) for non-local
recipient akka://sparkMaster@192.168.1.129:7077/remote at
akka://sparkMaster@127.0.0.1:7077 local is akka://sparkMaster@127.0.0.1:7077
".

It seems as if Akka were unwilling to deliver the RegisterWorker message to
the master program just because the recipient address (public address)
192.168.1.129 doesn't match with the loopback address that the master was
bound to. Is there any way to make Akka accept also the messages that were
not sent exactly to the same address that the master was bound to? This
could be a similar kind of a problem to [2].

[1] http://manpages.ubuntu.com/manpages/lucid/man1/redir.1.html
[2] https://spark-project.atlassian.net/browse/SPARK-625


Mime
View raw message