|
|
+
IGZ Nick 2012-03-04, 14:23
-
Re: Chaining multiple reducers most efficientlyBinglin Chang 2012-03-04, 15:00
No... Maybe in the future
On Sun, Mar 4, 2012 at 10:23 PM, IGZ Nick <[EMAIL PROTECTED]> wrote: > Hi, > > I would like to chain multiple reducers without an intervening map phase. > I looked at ChainReducer but it seems to support chains of the for M+RM*. > What I am looking for is M+R*. What would be the mos t efficient way to do > it. Of course, I could use an IdentityMapper in between, but I don;t want > to introduce an unnecessary mapper. I want to start the next > shuffle-sort-reduce cycle right after the first reducer does its job. Is it > possible? I am using hadoop 0.20.2-append. > > Regards, > |