spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From soumick86 <sdasgu...@dstsystems.com>
Subject Have different reduce key than mapper key
Date Wed, 23 Jul 2014 15:22:12 GMT
How can I transform the mapper key at the reducer output. The functions I
have encountered are combineByKey, reduceByKey, etc that work on the values
and not on the key. For example below, this is what I want to achieve but
seems like I can only have K1 and not K2:

Mapper----->(K1,V1)----->Reducer----->(K2,V2)

I must be missing something. Is there a class/method available? Also I am
using the Java API



--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Have-different-reduce-key-than-mapper-key-tp10503.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

Mime
View raw message