Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop, mail # general - hadoop simple monitor


+
周梦想 2013-01-05, 09:29
+
sunduncan 2013-01-05, 09:36
Copy link to this message
-
Re: hadoop simple monitor
mlanciau 2013-01-05, 09:32
Thanks a lot I will look @ on monday

Best Regards
Le 5 janv. 2013 10:30, "周梦想" <[EMAIL PROTECTED]> a écrit :

> Hello,
> I write a bash script to monitor all nodes of Hadoop system. It can monitor
> memory, disk usage and hadoop,thirift,hbase process exit.
>
> Simple Monitor for Hadoop Processes, Memory and Diskspace usage. If memory
> and disk usage reaches to a threshold, or some hadoop system process exit,
> the program will send email to make warnings.
> Features:
>
>    1. Simple Monitor Hadoop Processes, Memory and Diskspace usage of every
>    hosts that configured.
>    2. Deploy is simple. Just copy or uncompress the code to one station,
>    and it can monitor each remote hosts.( Do not need to deploy to any
> nodes
>    to be monitored.)
>    3. Write by Bash script, It's easy to modify.
>    4. It can monitor java processes(Such as HBase,Thrift,Hadoop processes)
>    or other processes(need a little change)
>
> Deploy:
>
> Just copy or uncompress the code to a directory, configured to monitor all
> remote hosts, the remote hosts needn't any configure or deploy.
>
>    1. modify config.sh to configure parameters
>    2. check loopcheck.sh to modify paths, because crontab has a limited env
>    and PATH
>    3. check email sending is ok or not, you may need configure MTA such as
>    Postfix
>    4. configure crontab, every 5 minutes check the hosts
>
> 0-59/5 * * * * $HOME/smr/loopcheck.sh
>
>
> Download: https://code.google.com/p/hadoop-simple-monitor/
>
> May it could help some body.
>
> Best Regards,
>
> Andy Zhou
>