I am getting various kafka parameters (like NumFetchRequests, FetchRequestsPerSecond, ProduceRequestsPerSecond etc.) through JMX in case of kafka-0.7.
In kafka-0.8 i am doing the same but not able to get parameters.
There are some changes in reporting metrics in kafka-0.8 as compared to kafka-0.7. I have already noticed that. According to changes in kafka-0.8 i am trying to get kafka metrics using JMX through jmxtrans api.
Here is sample java code of getting jmx parameters using jmxtrans api:
Server kafkaJMXServer = new Server("127.0.0.1", "9999"); Query query1 = new Query();
query1.setObj("kafka.server:type=BrokerTopicMetrics,name=AllTopicsBytesInPerSec"); query1.addAttr("MeanRate"); kafkaJMXServer.addQuery(query1); JmxProcess process = new JmxProcess(kafkaJMXServer); JmxUtils.execute(process); System.out.println(query1.getResults());
Also want to know that in kafka-0.7 there is single MBean - SocketServerStats which provides all kafka Metrics. But in Kafka-0-8 there are individual MBeans (like AllTopicsBytesInPerSec, AllTopicsBytesOutPerSec etc.) for getting each parameter like ByteInRate, ByteOutRate etc.
Does kafka-0.8 provide any single MBean from which we can get all parameters? On Mon, Jul 1, 2013 at 3:47 PM, Jun Rao <[EMAIL PROTECTED]> wrote: *Thanks & Regards* *Hanish Bansal*
We are running two kafka nodes(lets say: kafka-1 and kafka-2) in cluster mode. If we produce data into kafka using replication factor=2 then its replica is created on second machine.
I am using jconsole to monitor kafka. if messages are going on kafka-1 then i am able to see kafka metrics on jconsole of kafka-1. But by connecting to jconsole for kafka-2 i am not seeing any metrics, i want to know why it is happening ??
For more clarity i am asking same question in other way: If one kafka node is storing replicas of data, then will it be visible on jconsole or not ? On Wed, Jul 3, 2013 at 1:06 PM, Hanish Bansal < [EMAIL PROTECTED]> wrote: *Thanks & Regards* *Hanish Bansal*
Does the Kafka data show up in the log dir in kafka-2? Since only the leader can serve any traffic, if there is only have one partition or all leaders are on one broker, not all metrics (e.g., produce/fetch rate) will show up on both brokers.
Jun On Mon, Jul 29, 2013 at 6:04 AM, Hanish Bansal < [EMAIL PROTECTED]> wrote:
Could you run kafka-list-topics to see whether the leader of those partitions are distributed on both brokers?
Jun On Mon, Jul 29, 2013 at 10:48 PM, Hanish Bansal < [EMAIL PROTECTED]> wrote:
NEW: Monitor These Apps!
Apache Lucene, Apache Solr and all other Apache Software Foundation projects and their respective logos are trademarks of the Apache Software Foundation.
Elasticsearch, Kibana, Logstash, and Beats are trademarks of Elasticsearch BV, registered in the U.S. and in other countries. This site and Sematext Group is in no way affiliated with Elasticsearch BV.
Service operated by Sematext