spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Earthson <>
Subject Re: cache not work as expected for iteration?
Date Sun, 04 May 2014 10:32:46 GMT
thx for the help, unpersist is excatly what I want:) 

I see that spark will remove some cache automatically when memory is full,
it is much more helpful if the rule satisfy something like LRU


It seems that persist and cache is some kind of lazy? 

View this message in context:
Sent from the Apache Spark User List mailing list archive at

View raw message