spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Kyle Ellrott <>
Subject Incremental Updates to an RDD
Date Sat, 07 Dec 2013 04:56:47 GMT
I'm trying to figure out if I can use an RDD to backend an interactive
server. One of the requirements would be to have incremental updates to
elements in the RDD, ie transforms that change/add/delete a single element
in the RDD.
It seems pretty drastic to do a full RDD filter to remove a single element,
or do the union of the RDD with another one of size 1 to add an element.
(Or is it?) Is there an efficient way to do this in Spark? Are there any
example of this kind of usage?

Thank you,

View raw message