spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Syed A. Hashmi" <shas...@cloudera.com>
Subject Re: GC overhead limit exceeded
Date Fri, 28 Mar 2014 10:31:37 GMT
Default is MEMORY_ONLY ... if you explicitly persist a RDD, you have to
explicitly unpersist it if you want to free memory during the job.


On Thu, Mar 27, 2014 at 11:17 PM, Sai Prasanna <ansaiprasanna@gmail.com>wrote:

> Oh sorry, that was a mistake, the default level is MEMORY_ONLY !!
> My doubt was, between two different experiments, are the RDDs cached in
> memory need to be unpersisted???
> Or it doesnt matter ?
>

Mime
View raw message