spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Artur Sukhenko <artur.sukhe...@gmail.com>
Subject Remaining folders in .sparkStaging directory after app was killed
Date Mon, 29 Aug 2016 16:06:04 GMT
Hello spark devs,

Whenever I  run spark app in yarn-cluster mode, do Ctrl+C to stop
spark-submit and yarn application -kill
I have remaining folders in hdfs:
.sparkStaging/application_1472140614688_0001
.sparkStaging/application_1472140614688_0002

Those folders will never be deleted?
And if so, the only way to clean them is to manually remove them from hdfs?


---
Sincerely,
Artur Sukhenko

Mime
View raw message