Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> Kafka stats description


Copy link to this message
-
Re: Kafka stats description
The important metrics are byte rate and message rate in both the clients
and the broker.

Thanks,

Jun
On Sat, Jun 15, 2013 at 9:44 AM, Hanish Bansal <
[EMAIL PROTECTED]> wrote:

> Thanks for reply Jun !
>
> But still not clear with significance of these parameters.
>
>
> On Sat, Jun 15, 2013 at 9:20 PM, Jun Rao <[EMAIL PROTECTED]> wrote:
>
> > AvgProduceRequestMs: avg time of a produce RPC request
> >
> > For mbeans with Num and Total, they represent the cumulated value since
> the
> > service is up.
> >
> > Thanks,
> >
> > Jun
> >
> >
> > On Fri, Jun 14, 2013 at 8:22 AM, Hanish Bansal <
> > [EMAIL PROTECTED]> wrote:
> >
> > > Hi
> > >
> > > I'm trying to fetch Kafka stats using JMX and able to fetch the
> > parameters
> > > mentioned below.
> > >
> > > Can somebody please elaborate on what each of these parameters signify.
> > > Although the name is pretty indicative but I still want to be sure. As
> > per
> > > my understanding:
> > >
> > > ProduceRequestsPerSecond - number of requests produced into Kafka per
> > > second
> > > FetchRequestsPerSecond - number of requests fetched from kafka per
> second
> > > AvgProduceRequestMs - ?
> > > MaxProduceRequestMs- ?
> > > AvgFetchRequestMs- ?
> > > MaxFetchRequestMs -?
> > > BytesReadPerSecond - Bytes read from kafka per second. So when the
> > consumer
> > > reads from the kafka broker this parameter is affected.
> > > BytesWrittenPerSecond - Bytes written into kafka per second. So when
> the
> > > producer produces into kafka broker this parameter is affected.
> > > NumFetchRequests - Total number of fetch requests from Kafka
> > > NumProduceRequests - Total number of produced requests into kafka
> > >
> > > TotalBytesRead - Total number of bytes read from Kafka. Is this from
> the
> > > beginning of the time when the kafka starts and never resets???
> > > TotalBytesWritten - Total number of bytes written into Kafka. Is this
> > also
> > > from
> > > the beginning of the time when the kafka starts and never resets???
> > > TotalFetchRequestMs - ?
> > > TotalProduceRequestMs - ?
> > >
> > > Here are the values I'm getting but I'm not able to properly interpret
> > > them.
> > >
> > > NumFetchRequests=5350287
> > >
> > > TotalFetchRequestMs=56605349834
> > >
> > > FetchRequestsPerSecond=92.76876273667219
> > >
> > > AvgFetchRequestMs=0.008763
> > >
> > > MaxFetchRequestMs=3.610314
> > >
> > >
> > > --
> > > *Thanks & Regards*
> > > *Hanish Bansal*
> > >
> >
>
>
>
> --
> *Thanks & Regards*
> *Hanish Bansal*
>