Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Kafka >> mail # user >> understanding how consumers pull messages off

Copy link to this message
understanding how consumers pull messages off
How do you actually setup a consumer group? i.e. a group of consumer
processes that will be pulling messages of a particular brokers topic?

>From what I understand the client has to keep track of the offset, if this
is done using zookeeper, does this mean for every message that is consumed,
it will make a call to zookeeper?  That seems to chatty for me, but how
else will multiple consumers coordinate which messages have been processed.
Jun Rao 2012-05-31, 16:06