hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Arun C Murthy <...@hortonworks.com>
Subject Re: combiner without reducer
Date Mon, 15 Apr 2013 20:20:02 GMT
Please open a jira, we can discuss.

Also, you might want to look at Apache Tez - one could easily get it to work with a bit of
hacking.

thanks,
Arun

On Apr 15, 2013, at 11:07 PM, Radim Kolar wrote:

> i have need for running combiner without reducers.
> 
> Workflow mapper -> sort -> combiner -> hdfs.
> 
> do you think that you will ever support that scenario? Its quite common because few hadoop
frameworks supports it, but they emulate it in mapper by caching results into memory.

--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/



Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message