spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Kyle Ellrott <kellr...@soe.ucsc.edu>
Subject Incremental Updates to an RDD
Date Sat, 07 Dec 2013 04:56:47 GMT
I'm trying to figure out if I can use an RDD to backend an interactive
server. One of the requirements would be to have incremental updates to
elements in the RDD, ie transforms that change/add/delete a single element
in the RDD.
It seems pretty drastic to do a full RDD filter to remove a single element,
or do the union of the RDD with another one of size 1 to add an element.
(Or is it?) Is there an efficient way to do this in Spark? Are there any
example of this kind of usage?

Thank you,
Kyle

Mime
View raw message