spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jack Kolokasis <koloka...@ics.forth.gr>
Subject Shuffle Spill to Disk
Date Sat, 28 Sep 2019 19:45:58 GMT
Hello,

I am trying to measure how many bytes spill to disk in shuffle operation 
and I get always zero. This is not correct because the spark local disk 
is utilized.

Can anyone explain me why the spill counter is zero?

Thanks,
Iacovos

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org


Mime
View raw message