-Fwd: Understanding MapReduce source code : Flush operations
nagarjuna kanamarlapudi 2014-01-06, 14:35
---------- Forwarded message ----------
From: nagarjuna kanamarlapudi <[EMAIL PROTECTED]>
Date: Mon, Jan 6, 2014 at 6:39 PM
Subject: Understanding MapReduce source code : Flush operations
To: [EMAIL PROTECTED]
I am using hadoop/ map reduce for aout 2.5 years. I want to understand the
internals of the hadoop source code.
Let me put my requirement very clear.
I want to have a look at the code where of flush operations that happens
after the reduce phase.
Reducer writes the output to OutputFormat which inturn pushes that to
memory and once it reaches 90% of chunk size it starts to flush the reducer
I essentially want to look at the code of that flushing operation.