spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jack Kolokasis <koloka...@ics.forth.gr>
Subject Profile Spark Executors
Date Fri, 18 Jan 2019 10:41:58 GMT
Hi all,

     I try to profile my spark executors performance when use on Heap 
persistent level in compare to use off-Heap persistent level. I use 
statsd-jvm-profiler to profile each executor.

 From the results i see that application spends 71,92% of its threads 
running the method sun.nio.ch.EPollArrayWrapper.epollWait(). This 
happens to all benchmarks execution. (Matrix Factorization, Linear 
Regression, etc)

Can anyone explain me why this happens ?

Thanks for your help,
--Iacovos Kolokasis

---------------------------------------------------------------------
To unsubscribe e-mail: dev-unsubscribe@spark.apache.org


Mime
View raw message