Kafka, mail # user - are commitOffsets botched to zookeeper? - 2013-05-17, 01:54
 Search Hadoop and all its subprojects:

Switch to Threaded View
Copy link to this message
are commitOffsets botched to zookeeper?
We are calling commitOffsets after every message consumption.  It looks to be ~60% slower, with 29 partitions.  If a single KafkaStream thread is from a connector, and there are 29 partitions, then commitOffsets sends 29 offset updates, correct?  Are these offset updates batched in one send to zookeeper?

NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB