Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> RPC - Queue Time when handlers are all waiting


Copy link to this message
-
Re: RPC - Queue Time when handlers are all waiting
There is any coprocessor on slaves, neither master.
How can i dump RPC queues?

Thanks!
2013/12/10 Jean-Marc Spaggiari <[EMAIL PROTECTED]>

> Here are the properties from the code regarding the handlers.
> hbase.master.handler.count
> hbase.regionserver.handler.count
> hbase.regionserver.replication.handler.count
> hbase.regionserver.metahandler.count
>
> Do you have any coprocessor configured on your slave cluster? Ar eyou able
> to dump the RPC queues every 5 seconds to see what is in?
>
> JM
>
>
>
> 2013/12/10 Federico Gaule <[EMAIL PROTECTED]>
>
> > I'm using hbase 0.94.13.
> > hbase.regionserver.metahandler.count is a more intuituve name for those
> > handlers :)
> >
> >
> > 2013/12/10 Nicolas Liochon <[EMAIL PROTECTED]>
> >
> > > It's hbase.regionserver.metahandler.count. Not sure it causes the issue
> > > you're facing, thought. What's your HBase version?
> > >
> > >
> > > On Tue, Dec 10, 2013 at 1:21 PM, Federico Gaule <[EMAIL PROTECTED]>
> > > wrote:
> > >
> > > > There is another set of handler we haven't customized "PRI IPC"
> > (priority
> > > > ?). What are those handlers used for? What is the property used to
> > > increase
> > > > the number of handlers?
> > hbase.regionserver.custom.priority.handler.count
> > > ?
> > > >
> > > > Thanks!
> > > >
> > > >
> > > > 2013/12/10 Federico Gaule <[EMAIL PROTECTED]>
> > > >
> > > > > I've increased hbase.regionserver.replication.handler.count 10x
> (30)
> > > but
> > > > > nothing have changed. rpc.metrics.RpcQueueTime_avg_time still shows
> > > > > activity :(
> > > > >
> > > > > Mon Dec 09 14:04:10 EST 2013REPL IPC Server handler 29 on 60000
> > WAITING
> > > > > (since 16hrs, 58mins, 56sec ago)Waiting for a call (since 16hrs,
> > > 58mins,
> > > > > 56sec ago) Mon Dec 09 14:04:10 EST 2013 REPL IPC Server handler 28
> on
> > > > > 60000WAITING (since 16hrs, 58mins, 56sec ago) Waiting for a call
> > (since
> > > > > 16hrs, 58mins, 56sec ago)Mon Dec 09 14:04:10 EST 2013 REPL IPC
> Server
> > > > > handler 27 on 60000 WAITING (since 16hrs, 58mins, 56sec ago)Waiting
> > > for a
> > > > > call (since 16hrs, 58mins, 56sec ago) Mon Dec 09 14:04:10 EST 2013
> > REPL
> > > > > IPC Server handler 26 on 60000WAITING (since 16hrs, 58mins, 56sec
> > > > ago)Waiting for a call (since 16hrs, 58mins, 56sec ago)
> > > > > ... ...
> > > > > ...
> > > > > ...
> > > > > Mon Dec 09 14:04:10 EST 2013 REPL IPC Server handler 2 on
> > 60000WAITING
> > > > > (since 16hrs, 58mins, 56sec ago) Waiting for a call (since 16hrs,
> > > 58mins,
> > > > > 56sec ago)Mon Dec 09 14:04:10 EST 2013 REPL IPC Server handler 1 on
> > > > 60000WAITING (since 16hrs, 58mins, 56sec ago)Waiting
> > > > > for a call (since 16hrs, 58mins, 56sec ago) Mon Dec 09 14:04:10 EST
> > > > 2013REPL IPC Server handler 0 on 60000WAITING
> > > > > (since 16hrs, 58mins, 56sec ago) Waiting for a call (since 16hrs,
> > > 58mins,
> > > > > 56sec ago)
> > > > > Thanks JM
> > > > >
> > > > >
> > > > > 2013/12/9 Jean-Marc Spaggiari <[EMAIL PROTECTED]>
> > > > >
> > > > >> Yes, default value is 3 in 0.94.14. If you have not changed it,
> then
> > > > it's
> > > > >> still 3.
> > > > >>
> > > > >> conf.getInt("hbase.regionserver.replication.handler.count", 3);
> > > > >>
> > > > >> Keep us posted on the results.
> > > > >>
> > > > >> JM
> > > > >>
> > > > >>
> > > > >> 2013/12/9 Federico Gaule <[EMAIL PROTECTED]>
> > > > >>
> > > > >> > Default value for hbase.regionserver.replication.handler.count
> > > (can't
> > > > >> find
> > > > >> > what is the default, Is it 3?)
> > > > >> > I'll do a try increasing that property
> > > > >> >
> > > > >> > Fri Dec 06 12:44:12 EST 2013REPL IPC Server handler 2 on
> > > 60020WAITING
> > > > >> > (since 8sec ago)Waiting for a call (since 8sec ago)Fri Dec 06
> > > 12:44:12
> > > > >> EST
> > > > >> > 2013REPL IPC Server handler 1 on 60020WAITING (since 8sec
> > > ago)Waiting
> > > > >> for a
> > > > >> > call (since 8sec ago)Fri Dec 06 12:44:12 EST 2013REPL IPC Server
> > > > >> handler 0
[image: http://www.despegar.com/galeria/images/promos/isodespegar1.png]

*Ing. Federico Gaule*
Líder Técnico - PAM <[EMAIL PROTECTED]>
Av. Corrientes 746 - Piso 9 - C.A.B.A. (C1043AAU)
tel. +54 (11) 4894-3500

*[image: Seguinos en Twitter!] <http://twitter.com/#!/despegarar> [image:
Seguinos en Facebook!] <http://www.facebook.com/despegar> [image: Seguinos
en YouTube!] <http://www.youtube.com/Despegar>*
*Despegar.com, Inc. *
El mejor precio para tu viaje.

Este mensaje es confidencial y puede contener información amparada por el
secreto profesional.
Si usted ha recibido este e-mail por error, por favor comuníquenoslo
inmediatamente respondiendo a este e-mail y luego eliminándolo de su
sistema.
El contenido de este mensaje no deberá ser copiado ni divulgado a ninguna
persona.