Kafka, mail # user - Re: are kafka consumer apps guaranteed to see msgs at least once? - 2013-11-22, 00:55
 Search Hadoop and all its subprojects:

Switch to Threaded View
Copy link to this message
-
Re: are kafka consumer apps guaranteed to see msgs at least once?
You likely need to use a custom offset solution if you plan on committing
every message. With many partitions this puts a large burden on Zookeeper,
you end up needing to roll over your zk transaction logs fast as well or
rist filling up disk
On Thu, Nov 21, 2013 at 6:20 PM, Guozhang Wang <[EMAIL PROTECTED]> wrote:
 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB