Kafka, mail # user - Re: Kafka log retentions - 2013-04-01, 20:00
Solr & Elasticsearch trainings in New York & San Fransisco [more info]
 Search Hadoop and all its subprojects:

Switch to Threaded View
Copy link to this message
-
Re: Kafka log retentions
Essentially,

There's a configuration property: log.retention.hours

This determines the minimum time a message will remain available on the
broker.  The default is 7 days.

The kafka broker doesn't keep track of whether the message has been
consumed or not (or how many times it has been consumed).

It's up to individual consumers to keep track of which message offset
they've consumed (which typically gets saved in zookeeper).

Jason
On Mon, Apr 1, 2013 at 12:50 PM, Philip O'Toole <[EMAIL PROTECTED]> wrote:
 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB