Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> Consumer not consuming for 1st time

Copy link to this message
Re: Consumer not consuming for 1st time
When it doesn't consume which offset is in the fetch request? You can find
out from the request log in the broker.


On Thu, Nov 21, 2013 at 5:17 AM, Tarang Dawer <[EMAIL PROTECTED]>wrote:

> Hello
> I am running a kafka 0.8 consumer with the following configuration : -
> fetch.size=1000000000
> zookeeper.session.timeout.ms=60000
> auto.offset.reset=smallest
> zookeeper.sync.time.ms=200
> auto.commit.enable=false
> i am doing manual increment of the offsets.
> while doing so, i am facing a problem as when i clear all the kafka &
> zookeeper logs, and start the consumer, the consumer sometimes shows
> inconsistent behaviour,  sometimes it starts consuming, sometimes it
> doesn't.
> if it doesn't then i kill the consumer and restart it again, only then the
> consumption starts.
> i am quite confused with the consumer behaviour. could somebody please help
> me out as to how and where am i going wrong ?
> Thanks & Regards
> Tarang Dawer