Kafka, mail # user - Re: We have an invalid message in a segment, how to deal with it? - 2013-04-13, 18:28
Solr & Elasticsearch trainings in New York & San Francisco [more info][hide]
 Search Hadoop and all its subprojects:

Switch to Threaded View
Copy link to this message
-
Re: We have an invalid message in a segment, how to deal with it?
You should be able to just bounce the broker. Our default policy is
that if we run out of space we shut down the broker automatically as
in that case there is no guarantee on what has been written to disk.
On startup if a clean shutdown hasn't been performed the broker should
run a recovery procedure on the log that includes checksumming all
messages. Invalid messages will be removed. Sounds like this isn't
what happened?

-Jay

On Sat, Apr 13, 2013 at 10:30 AM, Matthew Rathbone
<[EMAIL PROTECTED]> wrote:

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB