spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Josh Rosen <>
Subject Re: JavaPairRDD unpersist
Date Wed, 23 Oct 2013 21:19:28 GMT
This is a bug; all three Java*RDD classes should have had unpersist()
methods added to them, instead of just JavaRDD (
 I'll submit a pull request to fix this.  In 0.8, you can access the
underlying Scala RDD and call unpersist() on that:


If you want to know the details of why we need to add unpersist() to each
Java*RDD class, rather than adding it once in JavaRDDLike, check out the
"implementation traits" section of

- Josh

On Wed, Oct 23, 2013 at 2:01 PM, Yann Luppo <>wrote:

>  Hi,
>  I've noticed that in 0.8.0 JavaRDD got a new "unpersist" method. I was
> wondering if this method was going to be ported eventually to JavaPairRDD.
> Is this somewhere on the road map? Or should we just change all of our
> JavaPairRDD to JavaRDDs w/ tuples for now?
>  Thanks,
> Yann

View raw message