spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Marcelo Vanzin <van...@cloudera.com>
Subject Re: Thread-safety of a SparkListener
Date Fri, 01 Apr 2016 16:51:19 GMT
On Fri, Apr 1, 2016 at 9:23 AM, Truong Duc Kien <duckientruong@gmail.com> wrote:
> I need to gather some metrics using a SparkListener. Does the callback
> methods need to thread-safe or they are always call from the same thread ?

The callbacks are all fired on the same thread. Just be careful not to
block that thread for too long or Spark will start to drop events.

-- 
Marcelo

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org


Mime
View raw message