spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Guillermo Ortiz <konstt2...@gmail.com>
Subject Combiners in Spark
Date Mon, 02 Mar 2015 10:55:52 GMT
Which is the equivalent function to "Combiners" of MapReduce in Spark?
I guess that it's combineByKey, but is combineByKey executed locally?
I understand than functions as reduceByKey or foldByKey aren't executed locally.

Reading the documentation looks like combineByKey is equivalent to
reduceByKey just that combineByKey you can specify an different output
than the input you have.

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org


Mime
View raw message