bharath v 2010-03-04, 17:00
E. Sammer 2010-03-04, 17:06
Ashutosh Chauhan 2010-03-04, 19:41
-Re: Pipelining data from map to reduce
Jeff Hammerbacher 2010-03-04, 22:18
Also see "Breaking the MapReduce Stage Barrier" from UIUC:
On Thu, Mar 4, 2010 at 11:41 AM, Ashutosh Chauhan <
[EMAIL PROTECTED]> wrote:
> This idea is kicking around in academia.. not made into apache yet..
> You can get a working prototype from:
> On Thu, Mar 4, 2010 at 09:06, E. Sammer <[EMAIL PROTECTED]> wrote:
> > On 3/4/10 12:00 PM, bharath v wrote:
> >> Hi ,
> >> Can we pipeline the map output directly into reduce phase without
> >> storing it in the local filesystem (avoiding disk IOs).
> >> If yes , how to do that ?
> > Bharath:
> > No, there's no way to avoid going to disk after the mappers.
> > --
> > Eric Sammer
> > [EMAIL PROTECTED]
> > http://esammer.blogspot.com
Edward Capriolo 2010-03-04, 22:32
Scott Carey 2010-03-04, 23:46
Edward Capriolo 2010-03-05, 01:26