spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jack Kolokasis <>
Subject Shuffle Spill to Disk
Date Sat, 28 Sep 2019 19:45:58 GMT

I am trying to measure how many bytes spill to disk in shuffle operation 
and I get always zero. This is not correct because the spark local disk 
is utilized.

Can anyone explain me why the spill counter is zero?


To unsubscribe e-mail:

View raw message