Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop >> mail # general >> hadoop simple monitor


Copy link to this message
-
hadoop simple monitor
Hello,
I write a bash script to monitor all nodes of Hadoop system. It can monitor
memory, disk usage and hadoop,thirift,hbase process exit.

Simple Monitor for Hadoop Processes, Memory and Diskspace usage. If memory
and disk usage reaches to a threshold, or some hadoop system process exit,
the program will send email to make warnings.
Features:

   1. Simple Monitor Hadoop Processes, Memory and Diskspace usage of every
   hosts that configured.
   2. Deploy is simple. Just copy or uncompress the code to one station,
   and it can monitor each remote hosts.( Do not need to deploy to any nodes
   to be monitored.)
   3. Write by Bash script, It's easy to modify.
   4. It can monitor java processes(Such as HBase,Thrift,Hadoop processes)
   or other processes(need a little change)

Deploy:

Just copy or uncompress the code to a directory, configured to monitor all
remote hosts, the remote hosts needn't any configure or deploy.

   1. modify config.sh to configure parameters
   2. check loopcheck.sh to modify paths, because crontab has a limited env
   and PATH
   3. check email sending is ok or not, you may need configure MTA such as
   Postfix
   4. configure crontab, every 5 minutes check the hosts

0-59/5 * * * * $HOME/smr/loopcheck.sh
Download: https://code.google.com/p/hadoop-simple-monitor/

May it could help some body.

Best Regards,

Andy Zhou
+
sunduncan 2013-01-05, 09:36
+
mlanciau 2013-01-05, 09:32