Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Kafka >> mail # user >> Purgatory


+
Priya Matpadi 2013-10-31, 16:41
+
Marc Labbe 2013-10-31, 18:20
Hello Priya,

You can find the definitions of these two configs here:

http://kafka.apache.org/documentation.html#brokerconfigs

Guozhang
On Thu, Oct 31, 2013 at 11:20 AM, Marc Labbe <[EMAIL PROTECTED]> wrote:

> Hi Priya
>
> my understanding is producer requests will be delayed (and put in request
> purgatory) only if your producer uses ack=-1. It will be in the purgatory
> (delayed) until all brokers have acknowledged the messages to be
> replicated. The documentation suggests to monitor the
> ProducerRequestPurgatory size metrics , but it only applies if you're using
> ack=-1, otherwise, this value will always be 0.
>
> For consumer requests, they'll be in purgatory (delayed) until the max
> allowed time to respond has been reached, unless it has enough messages to
> fill the buffer before that. The request will not end up in the purgatory
> if you're making a blocking request (max wait <= 0).
>
> Not sure about the configuration interval though.
>
> marc
>
>
> On Thu, Oct 31, 2013 at 12:41 PM, Priya Matpadi <
> [EMAIL PROTECTED]
> > wrote:
>
> > Hello,
> > What is purgatory? I believe the following two properties relate to
> > consumer and producer respectively.
> > Could someone please explain the significance of these?
> > fetch.purgatory.purge.interval.requests=100
> > producer.purgatory.purge.interval.requests=100
> >
> > Thanks,
> > Priya
> >
>

--
-- Guozhang

 
+
Priya Matpadi 2013-11-01, 06:45
+
Joe Stein 2013-11-01, 13:38
+
Marc Labbe 2013-11-01, 19:34
+
Joel Koshy 2013-11-01, 20:33
+
Marc Labbe 2013-11-02, 01:09
+
Joe Stein 2013-11-02, 01:44
+
Marc Labbe 2013-11-08, 03:46
+
Joel Koshy 2013-11-08, 07:01
+
Joel Koshy 2013-11-08, 21:01
+
Priya Matpadi 2013-11-10, 17:15
+
Marc Labbe 2013-11-11, 04:06
+
Marc Labbe 2013-11-08, 15:51
+
Guozhang Wang 2013-11-08, 17:29
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB