Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka, mail # user - Consumer offset oscillates between 2 values


Copy link to this message
-
Re: Consumer offset oscillates between 2 values
Joel Koshy 2013-07-16, 07:09
There has to be some live/stray consumer somewhere committing that
offset given the information shown in mtime. Can you check under
/consumers/g1/ids to see what if there are any registered consumers?

On Mon, Jul 15, 2013 at 12:27 PM, arathi maddula
<[EMAIL PROTECTED]> wrote:
> Hi,
> I use a Java high level consumer to read from a topic with compression set
> to snappy. When I query the consumer offset for that group using zookeeper
> shell, the offset value oscillates between 2 values. I use kafka 0.8 and I
> never faced this issue before. This happens even when there are no high
> level consumers running. Could you please tell why this happens?
>
> get /consumers/g1/offsets/z1/0
> *45212345*
> cZxid = 0x54a5aa
> ctime = Mon Jul 08 14:10:00 EDT 2013
> mZxid = 0x6bb643
> mtime = Mon Jul 15 15:24:47 EDT 2013
> pZxid = 0x54a5aa
> cversion = 0
> dataVersion = 857118
> aclVersion = 0
> ephemeralOwner = 0x0
> dataLength = 8
> numChildren = 0
>
> get /consumers/g1/offsets/z1/0
> *28997714*
> cZxid = 0x54a5aa
> ctime = Mon Jul 08 14:10:00 EDT 2013
> mZxid = 0x6bb67e
> mtime = Mon Jul 15 15:25:07 EDT 2013
> pZxid = 0x54a5aa
> cversion = 0
> dataVersion = 857157
> aclVersion = 0
> ephemeralOwner = 0x0
> dataLength = 8
> numChildren = 0
>
>
>
> Thanks
> Arathi