spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sean Owen <so...@cloudera.com>
Subject Re: Transform RDD.groupBY result to multiple RDDs
Date Thu, 20 Nov 2014 06:51:13 GMT
What's your use case? You would not generally want to make so many small
RDDs.
On Nov 20, 2014 6:19 AM, "Dai, Kevin" <yundai@ebay.com> wrote:

>  Hi, all
>
>
>
> Suppose I have a RDD of (K, V) tuple and I do groupBy on it with the key K.
>
>
>
> My question is how to make each groupBy resukt whick is (K, iterable[V]) a
> RDD.
>
>
>
> BTW, can we transform it as a DStream and also each groupBY result is a
> RDD in it?
>
>
>
> Best Regards,
>
> Kevin.
>

Mime
View raw message