spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Eugene Morozov <>
Subject Eviction of RDD persisted on disk
Date Thu, 13 Aug 2015 14:15:29 GMT

I know there is LRU eviction policy for the in memory cached partitions, but unfortunately
I cannot find anything regarding evicition policy from rdd presisted on disk. Is there any?

Does spark assume that it has infinite disk available and never evict anything? Even then,
if it’s true, stored partitions have to be deleted somehow. How is that happened?
Eugene Morozov

View raw message