spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Artur Sukhenko <>
Subject Remaining folders in .sparkStaging directory after app was killed
Date Mon, 29 Aug 2016 16:06:04 GMT
Hello spark devs,

Whenever I  run spark app in yarn-cluster mode, do Ctrl+C to stop
spark-submit and yarn application -kill
I have remaining folders in hdfs:

Those folders will never be deleted?
And if so, the only way to clean them is to manually remove them from hdfs?

Artur Sukhenko

View raw message