-Re: duplicat and lost message in Kafka
Jun Rao 2013-04-23, 04:10
In 0.8, a producer can choose to receive an ack after all replicas have
received the message. In this mode, a published message won't be lost on
individual broker failure.
On Mon, Apr 22, 2013 at 12:03 PM, Yu, Libo <[EMAIL PROTECTED]> wrote:
> I have read both the Kafka design document at
> and the paper. And I have two questions about lost and duplicate message.
> "Without acknowledging the producer, there is no guarantee that every
> message is actually received by the broker." Is this still true as of now?
> Is there a
> solution to this issue in release 0.8?
> "However, in the case when a consumer process crashes without a clean
> the consumer process that takes over those partitions owned by the failed
> may get some duplicate messages that are after the last offset
> successfully committed
> to zookeeper." Does this issue have to be fixed on the consumer side as
> well? Why
> not fixed in Kafka?
> Libo Yu