Sorry if this question has already been answered, but I've search the archives, the project page and the wiki unsuccessfully.
I'd like to know the meaning of the jmx exposed metrics. I can guess based on the name but I'd like to be sure. Plus, some of them seem to be reset when I restart the server (or when a new file is created in the topic directory, I'm not sure), and some of them don't.
Is there a doc anywhere with this info?
PD: I'm using 0.7.2 and I know 0.8 changes some things, but I guess the basic stuff will remain the same...
Then I guess mi next question is: The jmx metric "Kafka -> kafka.BrokerTopicStat.<topic_name> -> MessagesIn" counts how many messages went in that topic since kafka was started, and it will reset to 0 when I restart the service, right?
Same thing for Kafka -> kafka.BrokerAllTopicStat -> MessagesIn, right?
Thanks! On Tue, Feb 11, 2014 at 5:35 PM, Tomas Nunez <[EMAIL PROTECTED]> wrote:
Yes, but this counts how many messages went in that topic, right? This should always be increasing and never decreasing, if I understand correctly.
I'm asking that because in my kafka configuration I have 18 topics, and in all of them but one this metric is increasing. There is a topic where this metric is going up and down like crazy, and I'm worried that something may be wrong with it.
And strangely this happens in 4 of 5 servers. There is a server where this topic is only increasing, never decreasing...
On Tue, Feb 11, 2014 at 6:49 PM, Neha Narkhede <[EMAIL PROTECTED]>wrote:
Or even simpler: Is there any way to know the number of messages in a topic, in a server? Is that "kafka.logs.topic -> CurrentOffset"? If not, what does that "CurrentOffset" means? On Tue, Feb 11, 2014 at 7:08 PM, Tomas Nunez <[EMAIL PROTECTED]> wrote:
Do you mean the # messages stored in the broker (since old messages are deleted automatically)? We don't have that jmx right now, but it's probably useful to add one. We do have a jmx on # unconsumed messages for a given consumer.
Jun On Thu, Feb 13, 2014 at 5:18 AM, Tomas Nunez <[EMAIL PROTECTED]> wrote:
Yes, I meant messages stored in the broker. We have the feeling that some messages are being lost in the mirrormaker process, and I'd like to make sure that's not happening. As the deployment is really young, we still haven't deleted any messages, so the number of messages in FE and BE should be the same, that's why I was thinking about that metric. But if we don't have it, I'm looking for new approaches...
On Thu, Feb 13, 2014 at 5:01 PM, Jun Rao <[EMAIL PROTECTED]> wrote:
NEW: Monitor These Apps!
Apache Lucene, Apache Solr and all other Apache Software Foundation project and their respective logos are trademarks of the Apache Software Foundation.
Elasticsearch, Kibana, Logstash, and Beats are trademarks of Elasticsearch BV, registered in the U.S. and in other countries. This site and Sematext Group is in no way affiliated with Elasticsearch BV.
Service operated by Sematext