spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Charles Feduke <charles.fed...@gmail.com>
Subject Re: where storagelevel DISK_ONLY persists RDD to
Date Sun, 25 Jan 2015 14:26:20 GMT
I think you want to instead use `.saveAsSequenceFile` to save an RDD to
someplace like HDFS or NFS it you are attempting to interoperate with
another system, such as Hadoop. `.persist` is for keeping the contents of
an RDD around so future uses of that particular RDD don't need to
recalculate its composite parts.

On Sun Jan 25 2015 at 3:36:31 AM Larry Liu <larryliu05@gmail.com> wrote:

> I would like to persist RDD TO HDFS or NFS mount. How to change the
> location?
>

Mime
View raw message