Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka, mail # user - are commitOffsets botched to zookeeper?


Copy link to this message
-
are commitOffsets botched to zookeeper?
Rob Withers 2013-05-17, 01:54
We are calling commitOffsets after every message consumption.  It looks to be ~60% slower, with 29 partitions.  If a single KafkaStream thread is from a connector, and there are 29 partitions, then commitOffsets sends 29 offset updates, correct?  Are these offset updates batched in one send to zookeeper?

thanks,
rob