spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jack Kolokasis <>
Subject Profile Spark Executors
Date Fri, 18 Jan 2019 10:41:58 GMT
Hi all,

     I try to profile my spark executors performance when use on Heap 
persistent level in compare to use off-Heap persistent level. I use 
statsd-jvm-profiler to profile each executor.

 From the results i see that application spends 71,92% of its threads 
running the method This 
happens to all benchmarks execution. (Matrix Factorization, Linear 
Regression, etc)

Can anyone explain me why this happens ?

Thanks for your help,
--Iacovos Kolokasis

To unsubscribe e-mail:

View raw message