I am trying to monitor our kafka cluster. For that I use a zookeeper client that reads the information of all the consumer and a jmx agent that connects to the brokers. I try to look for discrepancies between the data being produced and the data being consumed.
I dislike the idea of using two different connect types (jmx and zookeeper) for this so I wonder why broker does not publish the offset into zookeeper? I don't want the last offset, just and update every X seconds or minutes. Is there any reason for not doing that?
Other option is to use only jmx connections but then discovering the consumers is impossible.
Jun On Thu, Aug 22, 2013 at 8:42 AM, Pablo Barrera González < [EMAIL PROTECTED]> wrote:
NEW: Monitor These Apps!
Apache Lucene, Apache Solr and all other Apache Software Foundation projects and their respective logos are trademarks of the Apache Software Foundation.
Elasticsearch, Kibana, Logstash, and Beats are trademarks of Elasticsearch BV, registered in the U.S. and in other countries. This site and Sematext Group is in no way affiliated with Elasticsearch BV.
Service operated by Sematext