In 0.7.x, if the messages are compressed, there could be duplicated
messages during consumer rebalance. This is because we can only checkpoint
consumer offset at the compressed unit boundary. You may want to see if you
have unnecessary rebalances (seehttps://cwiki.apache.org/confluence/display/KAFKA/FAQ#FAQ-Whyaretheremanyrebalancesinmyconsumerlog%3F)
In 0.8, there won't be duplicated messages even when compression is enabled.
On Fri, Jul 19, 2013 at 1:16 PM, Sybrandy, Casey <
[EMAIL PROTECTED]> wrote: