Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> consumer offset not saved in zk


Copy link to this message
-
Re: consumer offset not saved in zk
I suspect you had auto.commit.enable=false and consumer.timeout.ms=10000.
Can you confirm the values for the above configs in your example?

Thanks,
Neha
On May 22, 2013 11:22 PM, "rk vishu" <[EMAIL PROTECTED]> wrote:

> Hello All,
>
> I recently started experimenting Kafka for my usecase. I am running 0.8 in
> two node kafka setup.
>
> I produced 20messages using a java program(1 partition with 2 replicas) and
> I am running the consumer code as given in the example
> https://cwiki.apache.org/KAFKA/consumer-group-example.html. Consumer
> consumes all the messages and after 10sec program shuts down. Based on the
> configuration in the example, i am expecting that consumer offsets will be
> saved on ZK. If i start the program again, i should not be consuming the
> same messages again. But i am seeing different behavior. Messages are
> getting replayed. I am not seeing any update in ZK also.
>
> [zk: localhost:2181(CONNECTED) 13] get /consumers/1
> null
> cZxid = 0x8009ff0ee
> ctime = Wed May 22 16:59:21 PDT 2013
> mZxid = 0x8009ff0ee
> mtime = Wed May 22 16:59:21 PDT 2013
> pZxid = 0x8009ff0f4
> cversion = 2
> dataVersion = 0
> aclVersion = 0
> ephemeralOwner = 0x0
> dataLength = 0
> numChildren = 2
>
>
> Could any one of you explain me what could be the issue?
>
> Ravi
>