Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> Kafka 0.8's ConsumerConnector.close() hangs if ZK is unavailable and autocommit is enabled


Copy link to this message
-
Re: Kafka 0.8's ConsumerConnector.close() hangs if ZK is unavailable and autocommit is enabled
Hi Yury,

When auto-commit is turned on, before the consumer shuts down completely it
needs to commit its last offset to ZK to avoid any duplicates consumed when
it starts over. If the ZK is not up running then the shutdown would rather
stuck than let it go and incur duplicates. This behavior is by design that
to make consistent offset maintenance, ZK should be up all the time.

Guozhang
On Mon, May 12, 2014 at 9:59 AM, Yury Ruchin <[EMAIL PROTECTED]> wrote: