spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Romi Kuntsman <>
Subject Snappy temp files not cleaned up
Date Thu, 06 Nov 2014 07:15:11 GMT

Spark has an internal cleanup mechanism
(defined by spark.cleaner.ttl, see
which cleans up tasks and stages.

However, in our installation, we noticed that Snappy temporary files and
never cleaned up.

Is it a misconfiguration? Missing feature? How do you deal with build-up of
temp files?


*Romi Kuntsman*, *Big Data Engineer*

View raw message