Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume >> mail # user >> Re: Setting up flume to use ganglia results in a lot of error messages in /var/log/messages


Copy link to this message
-
Re: Setting up flume to use ganglia results in a lot of error messages in /var/log/messages
I have not had success with Ganglia, due to the same issue I think as
you've encountered.

- Connor
On Wed, Jan 23, 2013 at 6:04 AM, Christian Schroer <[EMAIL PROTECTED]
> wrote:

> Hi,
>
> i have the same problem here, using Flume-NG 1.2 from CDH4.1.2.
> I deleted all related RRDs, gmetad recreates them and i see those errors
> again.
>
> Disk space, inodes, ... are fine. All RRDs not related to Flume-NG are
> fine, too.
>
> These errors result in a gmetad crash after while (more metrics => earlier
> crash). If I disable ganglia support gmetad runs without any problem.
>
> Regards
> Christian
>
> -----Ursprüngliche Nachricht-----
> Von: Alexander Alten-Lorenz [mailto:[EMAIL PROTECTED]]
> Gesendet: Mittwoch, 12. Dezember 2012 15:43
> An: [EMAIL PROTECTED]
> Betreff: Re: Setting up flume to use ganglia results in a lot of error
> messages in /var/log/messages
>
> Looks like the RRD's are damaged, maybe the harddisk full?
>
> - Alex
>
> On Dec 12, 2012, at 11:38 AM, Juhani Connolly <
> [EMAIL PROTECTED]> wrote:
>
> > We just noticed that ganglia's gmetad is spamming messages like the
> following
> >
> > Dec  9 03:13:20 om-pat-obs01 /usr/sbin/gmetad[17407]: RRD_update
> (/var/lib/ganglia/rrds/Flume KDDI/blog-wap02/flume.SINK.avro2.Type.rrd):
> /var/lib/ganglia/rrds/Flume KDDI/blog-wap02/flume.SINK.avro2.Type.rrd:
> conversion of 'SINK' to float not complete: tail 'SINK'
> > Dec  9 03:13:20 om-pat-obs01 /usr/sbin/gmetad[17407]: RRD_update
> (/var/lib/ganglia/rrds/Flume KDDI/blog-wap02/flume.CHANNEL.ch1.Type.rrd):
> /var/lib/ganglia/rrds/Flume KDDI/blog-wap02/flume.CHANNEL.ch1.Type.rrd:
> conversion of 'CHANNEL' to float not complete: tail 'CHANNEL'
> > Dec  9 03:13:20 om-pat-obs01 /usr/sbin/gmetad[17407]: RRD_update
> (/var/lib/ganglia/rrds/Flume KDDI/blog-wap11/flume.SINK.avro1.Type.rrd):
> /var/lib/ganglia/rrds/Flume KDDI/blog-wap11/flume.SINK.avro1.Type.rrd:
> conversion of 'SINK' to float not complete: tail 'SINK'
> > Dec  9 03:13:20 om-pat-obs01 /usr/sbin/gmetad[17407]: RRD_update
> (/var/lib/ganglia/rrds/Flume KDDI/blog-wap11/flume.SOURCE.scribe.Type.rrd):
> /var/lib/ganglia/rrds/Flume KDDI/blog-wap11/flume.SOURCE.scribe.Type.rrd:
> conversion of 'SOURCE' to float not complete: tail 'SOURCE'
> >
> > The counters are tracked fine on the web interface, but we've had
> issues(gmetad crashing or not starting up, I'm still trying to get
> specifics from the responsible people). I can't say for sure if this is a
> ganglia problem or a problem with flumes ganglia support. Anyone else
> feeding their counters to ganglia getting similar? Perhaps the ganglia ml
> may be more appropriate, not sure on this one.
>
> --
> Alexander Alten-Lorenz
> http://mapredit.blogspot.com
> German Hadoop LinkedIn Group: http://goo.gl/N8pCF
>
>
+
Mike Percy 2013-01-23, 21:23
+
Hari Shreedharan 2013-01-23, 21:38
+
Hari Shreedharan 2013-01-23, 22:14