Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> Ganglia Metrics Reporter


Copy link to this message
-
Re: Ganglia Metrics Reporter
Cool!

At WMF, we use jmxtrans to do this:
https://github.com/jmxtrans/jmxtrans

And, if you use puppet, here's a nice little module to help generate jmxtrans json files, and an example of metrics we were sending to Ganglia from Kafka 0.7.2.

https://github.com/wikimedia/puppet-jmxtrans#kafka-broker-with-jmxtrans-ganglia-output
On Aug 22, 2013, at 11:42 AM, Maxime Brugidou <[EMAIL PROTECTED]> wrote:

> Hi all,
>
> Since I couldn't find any other way to publish kafka metrics to ganglia
> from kafka 0.8 (beta), I just published on github a super-simple ganglia
> metrics reporter for Kafka. It is configurable through the kafka config
> file and you can use it on the broker side and on your consumers/producers.
> There is also a feature to exclude some metrics with a regex (useful if you
> have many topics/partions).
>
> Here it is on github: https://github.com/criteo/kafka-ganglia
>
> Let me know if you have issues/questions. This is using metrics-ganglia
> 2.2.0 directly so it is not a ganglia plugin but rather a kafka "add-on".
>
> I don't know the proper way to distribute this yet for installation on
> brokers, it could also be part of some contrib kafka code.
>
> Cheers,
> Maxime