Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce, mail # user - Understanding MapReduce source code : Flush operations

Copy link to this message
Understanding MapReduce source code : Flush operations
nagarjuna kanamarlapudi 2014-01-06, 13:09

I am using hadoop/ map reduce for aout 2.5 years. I want to understand the
internals of the hadoop source code.

Let me put my requirement very clear.

I want to have a look at the code where of flush operations that happens
after the reduce phase.

Reducer writes the output to OutputFormat which inturn pushes that to
memory and once it reaches 90% of chunk size it starts to flush the reducer

I essentially want to look at the code of that flushing operation.
Nagarjuna K