Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Kafka >> mail # user >> Any detail for Kafka Mbeans/yammer-Metrics obtained from JMX


+
Monika Garg 2013-10-21, 12:43
+
Neha Narkhede 2013-10-21, 15:05
+
Monika Garg 2013-10-21, 16:43
+
Jun Rao 2013-10-22, 03:31
+
Monika Garg 2013-10-22, 07:55
+
Jun Rao 2013-10-22, 15:21
Copy link to this message
-
Re: Any detail for Kafka Mbeans/yammer-Metrics obtained from JMX
Thanks Jun.
On Tue, Oct 22, 2013 at 8:51 PM, Jun Rao <[EMAIL PROTECTED]> wrote:

> When a broker goes down, we have an optimization in the controller that
> proactively shrinks ISR. The ISR shrink rate only measures the rate that
> the leader shrinks ISR and doesn't reflect the shrinking by the controller.
> In general, having ISR shrink rate stay at 0 is a good thing since it means
> that the followers can always keep up.
>
> Thanks,
>
> Jun
>
>
> On Tue, Oct 22, 2013 at 12:55 AM, Monika Garg <[EMAIL PROTECTED]>
> wrote:
>
> > Thanks a lot Jun.
> >
> > Now im getting the values in ISR expansion rate,whenever broker goes down
> > and then up.
> >
> > But still ISR shrink rate is always having value 0.
> >
> > what I have done is:
> >
> > I made 3 node cluster.Than created 5 partitions with replica=3.
> > partitions got distributed on 1,2,3 brokers with isr= 1,2,3, and replica
> =
> > 1,2,3
> > broker -3 is leader for 2 partitions.
> >
> > then i stopped one broker(say 3),then isr = 1,2 and replica = 1,2,3.
> > In this case I waited for some time to get the ISR shrink value to get
> > updated in my jconsole,but value remained 0 for all attributes of ISR
> > shrink rate.
> >
> > Then I started broker(say 3) that i stopped earlier,what I saw is:
> >
> > ISR expansion rate has the values as:
> >
> > count -2 (on both other brokers 1,2)
> > oneminuterate - 0.012 etc.
> >
> > then I again stopped broker-1,still isr shrink rate not getting any
> > value.Can you please check?
> >
> > One more thing if you can please have a look:
> > How the other attributes like FifteenMinuteRate,OneMinuteRate etc are
> > continuosly changing for any Mbean.
> >
> >
> >
> >
> >
> >
> >
> > On Tue, Oct 22, 2013 at 9:00 AM, Jun Rao <[EMAIL PROTECTED]> wrote:
> >
> > > Updated the description in
> > > http://kafka.apache.org/documentation.html#monitoring. Does that help
> > make
> > > things clearer?
> > >
> > > Thanks,
> > >
> > > Jun
> > >
> > >
> > > On Mon, Oct 21, 2013 at 9:43 AM, Monika Garg <[EMAIL PROTECTED]>
> > wrote:
> > >
> > > > Thanks for replying Neha.It helped me a lot in getting the things
> more
> > > > clear.
> > > > I just have some doubts for the value of below Mbeans,please have a
> > look:
> > > > (1)ISR expansion
> > > > rate::"kafka.server":name="ISRShrinksPerSec",type="ReplicaManager"
> > > > ,non-zero only during broker startup.
> > > > Does the property (1) mean that,it will be become zero when any
> broker
> > > (in
> > > > a 2 node cluster)is started,and will be non-zero again if both the
> > > brokers
> > > > are stopped.
> > > > (2)ISR shrink
> > > > rate::"kafka.server":name="ISRShrinksPerSec",type="ReplicaManager"
> > > > , 0
> > > > Will this property(2) be always be zero?
> > > > Thanks.
> > > >
> > > >
> > > >
> > > >
> > > >
> > > > On Mon, Oct 21, 2013 at 8:35 PM, Neha Narkhede <
> > [EMAIL PROTECTED]
> > > > >wrote:
> > > >
> > > > > You may find this useful -
> > > > > http://kafka.apache.org/documentation.html#monitoring
> > > > >
> > > > > Let us know how we can improve the documentation further.
> > > > >
> > > > > Thanks,
> > > > > Neha
> > > > >
> > > > >
> > > > > On Mon, Oct 21, 2013 at 5:42 AM, Monika Garg <[EMAIL PROTECTED]
> >
> > > > wrote:
> > > > >
> > > > > > Hi,
> > > > > >
> > > > > > I am getting so many Mbeans from My JMX like
> > > kafka.server,kafka.network
> > > > > > etc.
> > > > > >
> > > > > > There are of different types and have a lot of attributes.
> > > > > >
> > > > > > I am trying to get when the attribute value for any Mbean is
> > getting
> > > > > > changed.
> > > > > >
> > > > > > But no helpful docs I am getting for it on google.
> > > > > >
> > > > > > Even the terms used like
> > > > > >
> > kafka.server":type="FetchRequestPurgatory",name="PurgatorySize",here
> > > > > > how/when  the value of PurgatorySize get change.No clue for this.
> > > > > > Similar to this there are a lot more values like
> > > > > >
> > > > > > when a topic is created,there is 554 values in kafka.network

*Moniii*

 
+
Monika Garg 2013-10-22, 17:41
+
Joel Koshy 2013-10-22, 17:58
+
Monika Garg 2013-10-23, 05:24
+
Monika Garg 2013-10-22, 08:01