spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vivekananda Venkateswaran <svven...@gmail.com>
Subject Re: Extracting RDD of values per key from PairRDD
Date Tue, 03 Nov 2015 14:30:37 GMT
Hi Deepak,

AFAIK, such nested RDDs are not allowed.

Thanks,
-Venkat.

On Tue, Nov 3, 2015 at 4:20 PM, Deepak Gopalakrishnan <dgkris@gmail.com>
wrote:

> Hello,
>
> I have a use case where I need to get *an RDD of values per key *from a PairRDD. Below
is my PairRDD.
>
> JavaPairRDD<Double, Iterable<Vector>> classifiedSampleRdd = sampleRDD.groupByKey();
>
> I want a separate RDD for the vectors per double entry in the key. *I would now want
a RDD of values for each key.* Which will be
>
> JavaRDD<Vector> = classifiedSampleRdd. ???
>
>
> Can someone tell me how I can extract that ?
>
> Thanks
> Deepak
>
>

Mime
View raw message