spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Adrian Mocanu <amoc...@verticalscope.com>
Subject how to add rddID to tuples in DStream
Date Tue, 04 Mar 2014 18:08:00 GMT
Hi
I've another simple question:
I have a DStream and want to add the ID of each RDD to the tuples contained in that RDD and
return a DStream of them.
So far I've figured out how to do this via foreachRDD and return RDDs.
How to create a DStream from these RDDs? Or even better, how to use .map to do this on the
dstream like
  mystream.map( tuple => (tuple, getRDDIdSomehow) )

-Adrian


Mime
View raw message