Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # dev >> combiner without reducer

Radim Kolar 2013-04-15, 17:37
Copy link to this message
Re: combiner without reducer
Please open a jira, we can discuss.

Also, you might want to look at Apache Tez - one could easily get it to work with a bit of hacking.


On Apr 15, 2013, at 11:07 PM, Radim Kolar wrote:

> i have need for running combiner without reducers.
> Workflow mapper -> sort -> combiner -> hdfs.
> do you think that you will ever support that scenario? Its quite common because few hadoop frameworks supports it, but they emulate it in mapper by caching results into memory.

Arun C. Murthy
Hortonworks Inc.
Radim Kolar 2013-04-16, 15:04