spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stéphane Verlet <kaweahsoluti...@gmail.com>
Subject Re: rdd split into new rdd
Date Wed, 23 Dec 2015 15:26:44 GMT
You should be able to do that using mapPartition

On Wed, Dec 23, 2015 at 8:24 AM, Ted Yu <yuzhihong@gmail.com> wrote:

> bq. {a=1, b=1, c=2, d=2}
>
> Can you elaborate your criteria a bit more ? The above seems to be a Set,
> not a Map.
>
> Cheers
>
> On Wed, Dec 23, 2015 at 7:11 AM, Yasemin Kaya <godot85@gmail.com> wrote:
>
>> Hi,
>>
>> I have data
>> *JavaPairRDD<String, TreeMap<String, Integer>> *format. In example:
>>
>> *(1610, {a=1, b=1, c=2, d=2}) *
>>
>> I want to get
>> *JavaPairRDD<String, List<String>>* In example:
>>
>>
>> *(1610, {a, b})*
>> *(1610, {c, d})*
>>
>> Is there a way to solve this problem?
>>
>> Best,
>> yasemin
>> --
>> hiç ender hiç
>>
>
>

Mime
View raw message