Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka, mail # user - Any detail for Kafka Mbeans/yammer-Metrics obtained from JMX


Copy link to this message
-
Re: Any detail for Kafka Mbeans/yammer-Metrics obtained from JMX
Monika Garg 2013-10-22, 07:55
Thanks a lot Jun.

Now im getting the values in ISR expansion rate,whenever broker goes down
and then up.

But still ISR shrink rate is always having value 0.

what I have done is:

I made 3 node cluster.Than created 5 partitions with replica=3.
partitions got distributed on 1,2,3 brokers with isr= 1,2,3, and replica =
1,2,3
broker -3 is leader for 2 partitions.

then i stopped one broker(say 3),then isr = 1,2 and replica = 1,2,3.
In this case I waited for some time to get the ISR shrink value to get
updated in my jconsole,but value remained 0 for all attributes of ISR
shrink rate.

Then I started broker(say 3) that i stopped earlier,what I saw is:

ISR expansion rate has the values as:

count -2 (on both other brokers 1,2)
oneminuterate - 0.012 etc.

then I again stopped broker-1,still isr shrink rate not getting any
value.Can you please check?

One more thing if you can please have a look:
How the other attributes like FifteenMinuteRate,OneMinuteRate etc are
continuosly changing for any Mbean.

On Tue, Oct 22, 2013 at 9:00 AM, Jun Rao <[EMAIL PROTECTED]> wrote:

> Updated the description in
> http://kafka.apache.org/documentation.html#monitoring. Does that help make
> things clearer?
>
> Thanks,
>
> Jun
>
>
> On Mon, Oct 21, 2013 at 9:43 AM, Monika Garg <[EMAIL PROTECTED]> wrote:
>
> > Thanks for replying Neha.It helped me a lot in getting the things more
> > clear.
> > I just have some doubts for the value of below Mbeans,please have a look:
> > (1)ISR expansion
> > rate::"kafka.server":name="ISRShrinksPerSec",type="ReplicaManager"
> > ,non-zero only during broker startup.
> > Does the property (1) mean that,it will be become zero when any broker
> (in
> > a 2 node cluster)is started,and will be non-zero again if both the
> brokers
> > are stopped.
> > (2)ISR shrink
> > rate::"kafka.server":name="ISRShrinksPerSec",type="ReplicaManager"
> > , 0
> > Will this property(2) be always be zero?
> > Thanks.
> >
> >
> >
> >
> >
> > On Mon, Oct 21, 2013 at 8:35 PM, Neha Narkhede <[EMAIL PROTECTED]
> > >wrote:
> >
> > > You may find this useful -
> > > http://kafka.apache.org/documentation.html#monitoring
> > >
> > > Let us know how we can improve the documentation further.
> > >
> > > Thanks,
> > > Neha
> > >
> > >
> > > On Mon, Oct 21, 2013 at 5:42 AM, Monika Garg <[EMAIL PROTECTED]>
> > wrote:
> > >
> > > > Hi,
> > > >
> > > > I am getting so many Mbeans from My JMX like
> kafka.server,kafka.network
> > > > etc.
> > > >
> > > > There are of different types and have a lot of attributes.
> > > >
> > > > I am trying to get when the attribute value for any Mbean is getting
> > > > changed.
> > > >
> > > > But no helpful docs I am getting for it on google.
> > > >
> > > > Even the terms used like
> > > > kafka.server":type="FetchRequestPurgatory",name="PurgatorySize",here
> > > > how/when  the value of PurgatorySize get change.No clue for this.
> > > > Similar to this there are a lot more values like
> > > >
> > > > when a topic is created,there is 554 values in kafka.network Mbean.
> > > >
> > > > Please any one can share any doc that explains the Mbeans for
> > Kafka-0.8.
> > > >
> > > > It will be really helpful for me.
> > > > Thanks.
> > > >
> > > > --
> > > > *Moni*
> > > >
> > >
> >
> >
> >
> > --
> > *Moniii*
> >
>

--
*Moniii*