spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Marcelo Vanzin <>
Subject Re: Thread-safety of a SparkListener
Date Fri, 01 Apr 2016 16:51:19 GMT
On Fri, Apr 1, 2016 at 9:23 AM, Truong Duc Kien <> wrote:
> I need to gather some metrics using a SparkListener. Does the callback
> methods need to thread-safe or they are always call from the same thread ?

The callbacks are all fired on the same thread. Just be careful not to
block that thread for too long or Spark will start to drop events.


To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message