Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Re: automatic monitoring the utilization of slaves


Copy link to this message
-
Re: automatic monitoring the utilization of slaves
Its not possible since the slave will don't have knowledge of other slaves ,
so though master started the job , it may be running in other slaves . So in
program if your running jobs using Job Conf then you can use it to track the
status of the job . Other wise you can dig into JobTracker WebUI code to see
how exactly interacting with master to get the info

On Thu, Jun 16, 2011 at 12:27 PM, bikash sharma <[EMAIL PROTECTED]>wrote:

> Hi -- Is there a way, by which a slave can get a trigger when a Hadoop jobs
> finished in master?
> The use case is as follows:
> I need to monitor the cpu, memory utilization utility automatically. For
> which, I need to know the timestamp to start and stop the sar utility
> corresponding to the start and finish of Hadoop job at master.
> Its simple to do at master, since the Hadoop job runs there, but how we do
> for slaves?
>
> Thanks.
> Bikash
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB