Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka, mail # user - Consumer not consuming for 1st time

Copy link to this message
Re: Consumer not consuming for 1st time
Jun Rao 2013-11-21, 16:29
When it doesn't consume which offset is in the fetch request? You can find
out from the request log in the broker.


On Thu, Nov 21, 2013 at 5:17 AM, Tarang Dawer <[EMAIL PROTECTED]>wrote:

> Hello
> I am running a kafka 0.8 consumer with the following configuration : -
> fetch.size=1000000000
> zookeeper.session.timeout.ms=60000
> auto.offset.reset=smallest
> zookeeper.sync.time.ms=200
> auto.commit.enable=false
> i am doing manual increment of the offsets.
> while doing so, i am facing a problem as when i clear all the kafka &
> zookeeper logs, and start the consumer, the consumer sometimes shows
> inconsistent behaviour,  sometimes it starts consuming, sometimes it
> doesn't.
> if it doesn't then i kill the consumer and restart it again, only then the
> consumption starts.
> i am quite confused with the consumer behaviour. could somebody please help
> me out as to how and where am i going wrong ?
> Thanks & Regards
> Tarang Dawer