How do you actually setup a consumer group? i.e. a group of consumer
processes that will be pulling messages of a particular brokers topic?

>From what I understand the client has to keep track of the offset, if this
is done using zookeeper, does this mean for every message that is consumed,
it will make a call to zookeeper?  That seems to chatty for me, but how
else will multiple consumers coordinate which messages have been processed.

Basically, each partition of a topic is only consumed by 1 consumer in a
group. So there is no coordination needed for advancing the offset of a
partition. By default, the offsets are checkpointed to ZK periodically.

Thanks,

Jun

On Thu, May 31, 2012 at 6:35 AM, S Ahmed <[EMAIL PROTECTED]> wrote:

> How do you actually setup a consumer group? i.e. a group of consumer
> processes that will be pulling messages of a particular brokers topic?
>
> From what I understand the client has to keep track of the offset, if this
> is done using zookeeper, does this mean for every message that is consumed,
> it will make a call to zookeeper?  That seems to chatty for me, but how
> else will multiple consumers coordinate which messages have been processed.
>