Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> how request.required.acks works


Copy link to this message
-
Re: how request.required.acks works
Thanks a lot Guohang, this makes sense.
On Fri, Oct 25, 2013 at 10:32 AM, Guozhang Wang <[EMAIL PROTECTED]> wrote:

> Hi Kane,
>
> You can find details of request.timeout.ms here:
>
> http://kafka.apache.org/documentation.html#configuration
>
> And yes, if a "timeout" response to sent back to the producer, it means the
> message may or may not have been committed.
>
> Guozhang
>
>
> On Fri, Oct 25, 2013 at 8:05 AM, Kane Kane <[EMAIL PROTECTED]> wrote:
>
> > Hello Neha,
> > Can you explain please what this means:
> > request.timeout.ms - The amount of time the broker will wait trying to
> > meet
> > the request.required.acks requirement before sending back an error to the
> > client.
> >
> > So the message will be committed even though broker sends error to
> client?
> >
> >
> > On Fri, Oct 25, 2013 at 7:41 AM, Neha Narkhede <[EMAIL PROTECTED]
> > >wrote:
> >
> > > The producer acknowledgement is independent of the leader follower
> > > replication. So if the message is written to the leader and the
> followers
> > > are healthy, the message will get committed.
> > >
> > > Thanks,
> > > Neha
> > > On Oct 24, 2013 8:35 PM, "Kane Kane" <[EMAIL PROTECTED]> wrote:
> > >
> > > > Hello Neha, does it mean even if not all replica acknowledged and
> > timeout
> > > > kicked in and producer get an exception - message still will be
> > written?
> > > >
> > > > Thanks.
> > > >
> > > >
> > > > On Thu, Oct 24, 2013 at 8:08 PM, Neha Narkhede <
> > [EMAIL PROTECTED]
> > > > >wrote:
> > > >
> > > > > The message will be written to the leader as well as the replicas.
> > > > >
> > > > > Thanks,
> > > > > Neha
> > > > >
> > > > >
> > > > > On Thu, Oct 24, 2013 at 7:08 PM, Guozhang Wang <[EMAIL PROTECTED]
> >
> > > > wrote:
> > > > >
> > > > > > Hi,
> > > > > >
> > > > > > In this case the request would be treated as timed out and hence
> > > > failed,
> > > > > if
> > > > > > the producer is async then after the number of retries it still
> > > failed,
> > > > > the
> > > > > > messages will be dropped.
> > > > > >
> > > > > > Guozhang
> > > > > >
> > > > > >
> > > > > > On Thu, Oct 24, 2013 at 6:50 PM, Kane Kane <
> [EMAIL PROTECTED]>
> > > > > wrote:
> > > > > >
> > > > > > > If i set request.required.acks to -1, and set relatively short
> > > > > > > request.timeout.ms and timeout happens before all replicas
> > > > acknowledge
> > > > > > the
> > > > > > > write - would be message written to the leader or dropped?
> > > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > -- Guozhang
> > > > > >
> > > > >
> > > >
> > >
> >
>
>
>
> --
> -- Guozhang
>

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB