Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # general >> hadoop simple monitor

Copy link to this message
Re:  hadoop simple monitor



发送时间:2013-01-05 17:30
主题:hadoop simple monitor

I write a bash script to monitor all nodes of Hadoop system. It can monitor
memory, disk usage and hadoop,thirift,hbase process exit.

Simple Monitor for Hadoop Processes, Memory and Diskspace usage. If memory
and disk usage reaches to a threshold, or some hadoop system process exit,
the program will send email to make warnings.

   1. Simple Monitor Hadoop Processes, Memory and Diskspace usage of every
   hosts that configured.
   2. Deploy is simple. Just copy or uncompress the code to one station,
   and it can monitor each remote hosts.( Do not need to deploy to any nodes
   to be monitored.)
   3. Write by Bash script, It's easy to modify.
   4. It can monitor java processes(Such as HBase,Thrift,Hadoop processes)
   or other processes(need a little change)


Just copy or uncompress the code to a directory, configured to monitor all
remote hosts, the remote hosts needn't any configure or deploy.

   1. modify config.sh to configure parameters
   2. check loopcheck.sh to modify paths, because crontab has a limited env
   and PATH
   3. check email sending is ok or not, you may need configure MTA such as
   4. configure crontab, every 5 minutes check the hosts

0-59/5 * * * * $HOME/smr/loopcheck.sh
Download: https://code.google.com/p/hadoop-simple-monitor/

May it could help some body.

Best Regards,

Andy Zhou