spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Suman Somasundar <>
Subject Log messages for shuffle phase
Date Fri, 12 Aug 2016 01:28:06 GMT


While going through the logs of an application, I noticed that I could not find any logs to
dig deeper into any of the shuffle phases.


I am interested in finding out time taken by each shuffle phase, the size of data spilled
to disk if any, among other things.


Does anyone know how I can do this?




View raw message