Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce, mail # user - how to observe spill operation during shuffle in mapreduce?


Copy link to this message
-
Re: how to observe spill operation during shuffle in mapreduce?
Ravi Kiran 2013-09-05, 08:02
Hi ,

   You can look at the job metrics from your jobtracker Web UI .  The
"Spilled Record" Counter under the group "Map Reduce Framework" displays
the number of records spilled in both map and reduce tasks.

Regards
Ravi Magham.
On Thu, Sep 5, 2013 at 12:23 PM, ch huang <[EMAIL PROTECTED]> wrote:

> hi,all:
>        is there any MR spill count metric?
>