spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Suman Somasundar <suman.somasun...@oracle.com>
Subject Log messages for shuffle phase
Date Fri, 12 Aug 2016 01:28:06 GMT
Hi,

 

While going through the logs of an application, I noticed that I could not find any logs to
dig deeper into any of the shuffle phases.

 

I am interested in finding out time taken by each shuffle phase, the size of data spilled
to disk if any, among other things.

 

Does anyone know how I can do this?

 

Thanks,

Suman.

Mime
View raw message