Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # dev >> combiner without reducer


+
Radim Kolar 2013-04-15, 17:37
Copy link to this message
-
Re: combiner without reducer
Please open a jira, we can discuss.

Also, you might want to look at Apache Tez - one could easily get it to work with a bit of hacking.

thanks,
Arun

On Apr 15, 2013, at 11:07 PM, Radim Kolar wrote:

> i have need for running combiner without reducers.
>
> Workflow mapper -> sort -> combiner -> hdfs.
>
> do you think that you will ever support that scenario? Its quite common because few hadoop frameworks supports it, but they emulate it in mapper by caching results into memory.

--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/
+
Radim Kolar 2013-04-16, 15:04