Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Fwd: Understanding MapReduce source code : Flush operations


Copy link to this message
-
Fwd: Understanding MapReduce source code : Flush operations
---------- Forwarded message ----------
From: nagarjuna kanamarlapudi <[EMAIL PROTECTED]>
Date: Mon, Jan 6, 2014 at 8:09 AM
Subject: Understanding MapReduce source code : Flush operations
To: [EMAIL PROTECTED]
Hi,

I am using hadoop/ map reduce for aout 2.5 years. I want to understand the
internals of the hadoop source code.

Let me put my requirement very clear.

I want to have a look at the code where of flush operations that happens
after the reduce phase.

Reducer writes the output to OutputFormat which inturn pushes that to
memory and once it reaches 90% of chunk size it starts to flush the reducer
output.

I essentially want to look at the code of that flushing operation.
Regards,
Nagarjuna K
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB