Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Chaining multiple reducers most efficiently


Copy link to this message
-
Re: Chaining multiple reducers most efficiently
No... Maybe in the future

On Sun, Mar 4, 2012 at 10:23 PM, IGZ Nick <[EMAIL PROTECTED]> wrote:

> Hi,
>
> I would like to chain multiple reducers without an intervening map phase.
> I looked at ChainReducer but it seems to support chains of the for M+RM*.
> What I am looking for is M+R*. What would be the mos t efficient way to do
> it. Of course, I could use an IdentityMapper in between, but I don;t want
> to introduce an unnecessary mapper. I want to start the next
> shuffle-sort-reduce cycle right after the first reducer does its job. Is it
> possible? I am using hadoop 0.20.2-append.
>
> Regards,
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB