spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mayur Rustagi <mayur.rust...@gmail.com>
Subject Re: update of RDDs
Date Thu, 01 May 2014 12:52:00 GMT
RDD are immutable so cannot be updated. You can create new RDD containing
updated entries(often not what you want to do).



Mayur Rustagi
Ph: +1 (760) 203 3257
http://www.sigmoidanalytics.com
@mayur_rustagi <https://twitter.com/mayur_rustagi>



On Thu, May 1, 2014 at 4:42 AM, narayanabhatla NarasimhaMurthy <
NN.Murthy@cmcltd.com> wrote:

> In our application, we need distributed RDDs containing key-value maps. We
> have operations that update RDDs by way of adding entries to the map,
> delete
> entries from the map as well as update value part of maps.
> We also have map reduce functions that operate on the RDDs.The questions
> are
> the following.
> 1. Can RDDs be updated? if Yes, what rae the methods?
> 2. If we update RDDs, will it happen in place or does it create new RDDs
> with almost double the original RDD size (original+newly created RDD)?
> Thank you very much.
> N.N.Murthy
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/update-of-RDDs-tp5132.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>

Mime
View raw message