Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume >> mail # user >> Re: Setting up flume to use ganglia results in a lot of error messages in /var/log/messages


+
Connor Woodson 2013-01-23, 21:12
+
Juhani Connolly 2012-12-12, 10:38
Copy link to this message
-
Re: Setting up flume to use ganglia results in a lot of error messages in /var/log/messages
Looks like the RRD's are damaged, maybe the harddisk full?

- Alex

On Dec 12, 2012, at 11:38 AM, Juhani Connolly <[EMAIL PROTECTED]> wrote:

> We just noticed that ganglia's gmetad is spamming messages like the following
>
> Dec  9 03:13:20 om-pat-obs01 /usr/sbin/gmetad[17407]: RRD_update (/var/lib/ganglia/rrds/Flume KDDI/blog-wap02/flume.SINK.avro2.Type.rrd): /var/lib/ganglia/rrds/Flume KDDI/blog-wap02/flume.SINK.avro2.Type.rrd: conversion of 'SINK' to float not complete: tail 'SINK'
> Dec  9 03:13:20 om-pat-obs01 /usr/sbin/gmetad[17407]: RRD_update (/var/lib/ganglia/rrds/Flume KDDI/blog-wap02/flume.CHANNEL.ch1.Type.rrd): /var/lib/ganglia/rrds/Flume KDDI/blog-wap02/flume.CHANNEL.ch1.Type.rrd: conversion of 'CHANNEL' to float not complete: tail 'CHANNEL'
> Dec  9 03:13:20 om-pat-obs01 /usr/sbin/gmetad[17407]: RRD_update (/var/lib/ganglia/rrds/Flume KDDI/blog-wap11/flume.SINK.avro1.Type.rrd): /var/lib/ganglia/rrds/Flume KDDI/blog-wap11/flume.SINK.avro1.Type.rrd: conversion of 'SINK' to float not complete: tail 'SINK'
> Dec  9 03:13:20 om-pat-obs01 /usr/sbin/gmetad[17407]: RRD_update (/var/lib/ganglia/rrds/Flume KDDI/blog-wap11/flume.SOURCE.scribe.Type.rrd): /var/lib/ganglia/rrds/Flume KDDI/blog-wap11/flume.SOURCE.scribe.Type.rrd: conversion of 'SOURCE' to float not complete: tail 'SOURCE'
>
> The counters are tracked fine on the web interface, but we've had issues(gmetad crashing or not starting up, I'm still trying to get specifics from the responsible people). I can't say for sure if this is a ganglia problem or a problem with flumes ganglia support. Anyone else feeding their counters to ganglia getting similar? Perhaps the ganglia ml may be more appropriate, not sure on this one.

--
Alexander Alten-Lorenz
http://mapredit.blogspot.com
German Hadoop LinkedIn Group: http://goo.gl/N8pCF
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB