Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> Does Kafka stores Producer/Consumer Details

Copy link to this message
Re: Does Kafka stores Producer/Consumer Details
> I am wondering does metadata of Kafka stores producer/consumer information.
> As I start any producer,I provide a broker-list to it.But producer must be
> connecting to one of the broker to send data(as per Im gettiing the
> things).Similarly I can start more producer by giving a broker-list in the
> start command.
> So a broker must be storing the information about which producer is
> handshaking with it(as a producer will connect to only one broker at any
> time).

Not really - well, brokers obviously have to maintain these
connections from producers but it maintains no additional per-producer

> Same case goes with consumer.

Same for consumers. For high-level consumers, the consumers themselves
maintain state (e.g., registration, partition ownership, offsets) in
zookeeper but there is no per-consumer state on the broker (although
with KAFKA-1000, we will be moving offset management to the broker).