Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> error recovery in multiple thread reading from Kafka with HighLevel api


Copy link to this message
-
Re: error recovery in multiple thread reading from Kafka with HighLevel api
Maybe i could batch the messages before commit.., e.g committing every 10
second.this is what the auto commit does anyway and  I could live with
duplicate data.
What do u think?

I would then also seem to need a monitoring daemon to check the lag to
restart the consumer during machine crashes..
On Fri, Aug 8, 2014 at 10:40 AM, Chen Wang <[EMAIL PROTECTED]>
wrote: