-Re: collecting CPU, mem, iops of hadoop jobs
Patai Sangbutsarakum 2011-12-20, 21:11
Thanks for reply, but I don't think metric exposed to Ganglia would be
what i am really looking for..
what i am looking for is some kind of these (but not limit to)
CPU time: 10204 sec. <--aggregate from all tasknodes
IOPS: 2344 <-- aggregated from all datanode
MEM: 30G <-- aggregated
Sorry for ambiguous question.
On Tue, Dec 20, 2011 at 12:47 PM, He Chen <[EMAIL PROTECTED]> wrote:
> You may need Ganglia. It is a cluster monitoring software.
> On Tue, Dec 20, 2011 at 2:44 PM, Patai Sangbutsarakum <
> [EMAIL PROTECTED]> wrote:
>> Hi Hadoopers,
>> We're running Hadoop 0.20 CentOS5.5. I am finding the way to collect
>> CPU time, memory usage, IOPS of each hadoop Job.
>> What would be the good starting point ? document ? api ?
>> Thanks in advance