Since I couldn't find any other way to publish kafka metrics to ganglia from kafka 0.8 (beta), I just published on github a super-simple ganglia metrics reporter for Kafka. It is configurable through the kafka config file and you can use it on the broker side and on your consumers/producers. There is also a feature to exclude some metrics with a regex (useful if you have many topics/partions).
Note that the puppet module README I liked to isn't a full jmxtrans example JSON query. It is a jmxtrans puppet module usage example. So, using that in puppet will generate a .json file containing the query.
We'll be moving to 0.8 in the next coming months, and I'll try to get some real examples of Kafka 0.8 jmxtrans JSON queries up for you when we do. On Aug 22, 2013, at 11:55 PM, Jun Rao <[EMAIL PROTECTED]> wrote:
We wrote a library that is essentially the exact same thing as metrics. The only reason we didn't use metrics was because it didn't exist yet. There is a graphite reporter which could be purposed for metrics.
I'm using this at the Wikimedia Foundation to send Kafka Broker metrics to Ganglia. However, we use Ganglia in multicast mode. This mostly seems to work with your code, but the ttl on the multicast packets gets set at 1. We have sometimes have multiple levels of ganglia aggregators, and with ttl=1, the multicast packets don't make it to the proper aggregators.
I'm looking into either forking or rewriting this library using Codahale Metrics v 3.0.1, and supporting multicast more explicitly. Is this something you could do better/faster than me, or should I proceed? :)
(Thanks for writing this, btw!) On Aug 22, 2013, at 11:42 AM, Maxime Brugidou <[EMAIL PROTECTED]> wrote:
NEW: Monitor These Apps!
Apache Lucene, Apache Solr and all other Apache Software Foundation projects and their respective logos are trademarks of the Apache Software Foundation.
Elasticsearch, Kibana, Logstash, and Beats are trademarks of Elasticsearch BV, registered in the U.S. and in other countries. This site and Sematext Group is in no way affiliated with Elasticsearch BV.
Service operated by Sematext