Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka, mail # user - Metrics: via Broker vs. Producer vs. Consumer


Copy link to this message
-
Metrics: via Broker vs. Producer vs. Consumer
Otis Gospodnetic 2013-07-24, 14:29
Hi,

I was looking at
https://cwiki.apache.org/confluence/display/KAFKA/Operations#Operations-Monitoring
and noticed there is no information about which metrics are available
in which process/JVM/JMX.

Some are available in the Broker process, but some are only available
from the JVM running Consumer and some only from the JVM running
Producer.  And yet some Producer and Consumer metrics are, I *believe*
available from Broker's JMX.

Would it be possible for somebody in the know to mark the metrics in
https://cwiki.apache.org/confluence/display/KAFKA/Operations#Operations-Monitoring
so one can tell where to get it?

Also, why is it that the Broker process doesn't have *all* metrics,
including Producer and Consumer one?  Is that because there can be N
Brokers and each P or C talk to one Broker at a time and thus there is
no single process/JMX that can know *all* stats for *all* Brokers and
for *all* Ps and Cs?

Thank you!
Otis
--
Performance Monitoring -- http://sematext.com/spm
Solr & ElasticSearch Support -- http://sematext.com/