Kafka, mail # user - Changing log retention reset offsets? - 2013-03-15, 08:07
Solr & Elasticsearch trainings in New York & San Francisco [more info][hide]
 Search Hadoop and all its subprojects:

Switch to Threaded View
Copy link to this message
-
Changing log retention reset offsets?
Hi,
We changed the default log retention policy from 168 hrs (7days) to 750 hrs
(approx a month) and restarted the kafka servers. After the restart, when
we ran the console consumer with the --from-beginning flag, it did not get
messages from the beginning. Only messages added after the restart were
being retrieved. We suspect that the zookeeper offsets might have messed
up. We'r using kafka 0.7.2. Is this expected?

Regards,
Premal Shah.

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB