-Re: Does Kafka stores Producer/Consumer Details
Joel Koshy 2013-10-25, 14:31
> I am wondering does metadata of Kafka stores producer/consumer information.
> As I start any producer,I provide a broker-list to it.But producer must be
> connecting to one of the broker to send data(as per Im gettiing the
> things).Similarly I can start more producer by giving a broker-list in the
> start command.
> So a broker must be storing the information about which producer is
> handshaking with it(as a producer will connect to only one broker at any
Not really - well, brokers obviously have to maintain these
connections from producers but it maintains no additional per-producer
> Same case goes with consumer.
Same for consumers. For high-level consumers, the consumers themselves
maintain state (e.g., registration, partition ownership, offsets) in
zookeeper but there is no per-consumer state on the broker (although
with KAFKA-1000, we will be moving offset management to the broker).