I am wondering does metadata of Kafka stores producer/consumer information.
As I start any producer,I provide a broker-list to it.But producer must be connecting to one of the broker to send data(as per Im gettiing the things).Similarly I can start more producer by giving a broker-list in the start command.
So a broker must be storing the information about which producer is handshaking with it(as a producer will connect to only one broker at any time).
Same case goes with consumer.
is there any way to find the details about Producer/Consumer from Kafka,if I am right in explaining the above details?
Not really - well, brokers obviously have to maintain these connections from producers but it maintains no additional per-producer state. Same for consumers. For high-level consumers, the consumers themselves maintain state (e.g., registration, partition ownership, offsets) in zookeeper but there is no per-consumer state on the broker (although with KAFKA-1000, we will be moving offset management to the broker).
I don't think we directly maintain that information but it is readily available through standard OS-level tools (e.g., netstat).
NEW: Monitor These Apps!
Apache Lucene, Apache Solr and all other Apache Software Foundation project and their respective logos are trademarks of the Apache Software Foundation.
Elasticsearch, Kibana, Logstash, and Beats are trademarks of Elasticsearch BV, registered in the U.S. and in other countries. This site and Sematext Group is in no way affiliated with Elasticsearch BV.
Service operated by Sematext