spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tobias Pfeiffer <...@preferred.jp>
Subject Communication between Driver and Executors
Date Fri, 14 Nov 2014 04:58:13 GMT
Hi,

(this is related to my previous question about stopping the
StreamingContext)

is there any way to send a message from the driver to the executors? There
is all this Akka machinery running, so it should be easy to have something
like

  sendToAllExecutors(message)

on the driver and

  handleMessage {
    case _ => ...
  }

on the executors, right? Surely at least for Broadcast.unpersist() such a
thing must exist, so can I use it somehow (dirty way is also ok) to send a
message to my Spark nodes?

Thanks
Tobias

Mime
View raw message