Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Chaining multiple reducers most efficiently

Copy link to this message
Re: Chaining multiple reducers most efficiently
No... Maybe in the future

On Sun, Mar 4, 2012 at 10:23 PM, IGZ Nick <[EMAIL PROTECTED]> wrote:

> Hi,
> I would like to chain multiple reducers without an intervening map phase.
> I looked at ChainReducer but it seems to support chains of the for M+RM*.
> What I am looking for is M+R*. What would be the mos t efficient way to do
> it. Of course, I could use an IdentityMapper in between, but I don;t want
> to introduce an unnecessary mapper. I want to start the next
> shuffle-sort-reduce cycle right after the first reducer does its job. Is it
> possible? I am using hadoop 0.20.2-append.
> Regards,