Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> how to observe spill operation during shuffle in mapreduce?


Copy link to this message
-
Re: how to observe spill operation during shuffle in mapreduce?
Hi ,

   You can look at the job metrics from your jobtracker Web UI .  The
"Spilled Record" Counter under the group "Map Reduce Framework" displays
the number of records spilled in both map and reduce tasks.

Regards
Ravi Magham.
On Thu, Sep 5, 2013 at 12:23 PM, ch huang <[EMAIL PROTECTED]> wrote:

> hi,all:
>        is there any MR spill count metric?
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB