Good evening. I have read through section of monitoring. I tried to map each section to corresponding JMX attribute. I will appreciate if you answer a few questions bellow.
Thanks so much in advance, Vadim
What this JMX "kafka.controller":type="KafkaController",name="ActiveControllerCount" for?
The rate of data in and out of the cluster and the number of messages written Which jmx attributes should I monitor? Since I should alert on this What are acceptable changes? What are not? The log flush rate and the time taken to flush the log "kafka.log":type="LogFlushStats",name="LogFlushRateAndTimeMs" Which attribute I should be watching and what acceptable deviation change before I should alert The number of partitions that have replicas that are down or have fallen behind and are underreplicated. Is this the JMX "kafka.cluster":type="Partition",name="buypets-0-UnderReplicated" that will show replicas that are down?
Unclean leader elections. This shouldn't happen.
"kafka.controller":type="ControllerStats",name="UncleanLeaderElectionsPerSec". I assume that should always be 0 and if its not 0 we have problem. Number of partitions each node is the leader for. Which JMX attribute(s) monitors this? Leader elections: we track each time this happens and how long it took:
"kafka.controller":type="ControllerStats",name="LeaderElectionRateAndTimeMs" Any changes to the ISR Which JMX attribute I should monitor for this? Should I alert on this? What are reasonable changes? Which are not? The number of produce requests waiting on replication to report back Which JMX attribute I should monitor for this? Should I alert on this? What are reasonable changes? Which are not? The number of fetch requests waiting on data to arrive Which JMX attribute I should monitor for this? Should I alert on this? What are reasonable changes? Which are not?
I see this MBean: "kafka.server":name="AllTopicsMessagesInPerSec",type="BrokerTopicMetrics"
Does it return number per broker or per cluster? If it's per broker how to get global value per cluster and vice versa?
NEW: Monitor These Apps!
Apache Lucene, Apache Solr and all other Apache Software Foundation projects and their respective logos are trademarks of the Apache Software Foundation.
Elasticsearch, Kibana, Logstash, and Beats are trademarks of Elasticsearch BV, registered in the U.S. and in other countries. This site and Sematext Group is in no way affiliated with Elasticsearch BV.
Service operated by Sematext