spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Truong Duc Kien <duckientru...@gmail.com>
Subject Re: Thread-safety of a SparkListener
Date Fri, 01 Apr 2016 16:44:23 GMT
I need to process the events related to Task, Stage and Executor.

Regards,
Kien Truong

On Fri, Apr 1, 2016 at 5:34 PM, Ted Yu <yuzhihong@gmail.com> wrote:

> In general, you should implement thread-safety in your code.
>
> Which set of events are you interested in ?
>
> Cheers
>
> On Fri, Apr 1, 2016 at 9:23 AM, Truong Duc Kien <duckientruong@gmail.com>
> wrote:
>
>> Hi,
>>
>> I need to gather some metrics using a SparkListener. Does the callback
>> methods need to thread-safe or they are always call from the same thread ?
>>
>> Thanks,
>> Kien Truong
>>
>
>

Mime
View raw message