spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ashwin Sai Shankar <ashan...@netflix.com.INVALID>
Subject Spark shuffle files
Date Mon, 27 Mar 2017 19:38:52 GMT
Hi!

In spark on yarn, when are shuffle files on local disk removed? (Is it when
the app completes or
once all the shuffle files are fetched or end of the stage?)

Thanks,
Ashwin

Mime
View raw message