Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> How to get mapper counters (or equivalents) in reducer


Copy link to this message
-
How to get mapper counters (or equivalents) in reducer
Hi folks,

Version: Hadoop 0.20.205.

My reducer can be optimized if I can get a good estimate on how many
records are produced by the mappers, that is, if I can get the
MAP_OUTPUT_RECORDS counter (or its equivalent) in my reducer. However,
I tried and always got 0, guess the counters are not passed to the
reducer context.

Anybody has encountered the same requirement? And any pointers on that?

Appreciate your help.

Thanks,
James
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB