Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase >> mail # user >> RPC - Queue Time when handlers are all waiting


+
Federico Gaule 2013-12-05, 12:49
+
Federico Gaule 2013-12-07, 15:22
+
Bharath Vissapragada 2013-12-07, 15:33
+
Federico Gaule 2013-12-09, 13:18
+
Jean-Marc Spaggiari 2013-12-09, 13:55
+
Federico Gaule 2013-12-09, 14:13
+
Jean-Marc Spaggiari 2013-12-09, 14:30
+
Federico Gaule 2013-12-09, 14:46
+
Federico Gaule 2013-12-09, 15:07
+
Jean-Marc Spaggiari 2013-12-09, 15:35
+
Federico Gaule 2013-12-09, 15:48
+
Jean-Marc Spaggiari 2013-12-09, 15:53
+
Federico Gaule 2013-12-10, 12:05
+
Federico Gaule 2013-12-10, 12:21
+
Nicolas Liochon 2013-12-10, 12:59
Copy link to this message
-
Re: RPC - Queue Time when handlers are all waiting
I'm using hbase 0.94.13.
hbase.regionserver.metahandler.count is a more intuituve name for those
handlers :)
2013/12/10 Nicolas Liochon <[EMAIL PROTECTED]>

> It's hbase.regionserver.metahandler.count. Not sure it causes the issue
> you're facing, thought. What's your HBase version?
>
>
> On Tue, Dec 10, 2013 at 1:21 PM, Federico Gaule <[EMAIL PROTECTED]>
> wrote:
>
> > There is another set of handler we haven't customized "PRI IPC" (priority
> > ?). What are those handlers used for? What is the property used to
> increase
> > the number of handlers? hbase.regionserver.custom.priority.handler.count
> ?
> >
> > Thanks!
> >
> >
> > 2013/12/10 Federico Gaule <[EMAIL PROTECTED]>
> >
> > > I've increased hbase.regionserver.replication.handler.count 10x (30)
> but
> > > nothing have changed. rpc.metrics.RpcQueueTime_avg_time still shows
> > > activity :(
> > >
> > > Mon Dec 09 14:04:10 EST 2013REPL IPC Server handler 29 on 60000 WAITING
> > > (since 16hrs, 58mins, 56sec ago)Waiting for a call (since 16hrs,
> 58mins,
> > > 56sec ago) Mon Dec 09 14:04:10 EST 2013 REPL IPC Server handler 28 on
> > > 60000WAITING (since 16hrs, 58mins, 56sec ago) Waiting for a call (since
> > > 16hrs, 58mins, 56sec ago)Mon Dec 09 14:04:10 EST 2013 REPL IPC Server
> > > handler 27 on 60000 WAITING (since 16hrs, 58mins, 56sec ago)Waiting
> for a
> > > call (since 16hrs, 58mins, 56sec ago) Mon Dec 09 14:04:10 EST 2013 REPL
> > > IPC Server handler 26 on 60000WAITING (since 16hrs, 58mins, 56sec
> > ago)Waiting for a call (since 16hrs, 58mins, 56sec ago)
> > > ... ...
> > > ...
> > > ...
> > > Mon Dec 09 14:04:10 EST 2013 REPL IPC Server handler 2 on 60000WAITING
> > > (since 16hrs, 58mins, 56sec ago) Waiting for a call (since 16hrs,
> 58mins,
> > > 56sec ago)Mon Dec 09 14:04:10 EST 2013 REPL IPC Server handler 1 on
> > 60000WAITING (since 16hrs, 58mins, 56sec ago)Waiting
> > > for a call (since 16hrs, 58mins, 56sec ago) Mon Dec 09 14:04:10 EST
> > 2013REPL IPC Server handler 0 on 60000WAITING
> > > (since 16hrs, 58mins, 56sec ago) Waiting for a call (since 16hrs,
> 58mins,
> > > 56sec ago)
> > > Thanks JM
> > >
> > >
> > > 2013/12/9 Jean-Marc Spaggiari <[EMAIL PROTECTED]>
> > >
> > >> Yes, default value is 3 in 0.94.14. If you have not changed it, then
> > it's
> > >> still 3.
> > >>
> > >> conf.getInt("hbase.regionserver.replication.handler.count", 3);
> > >>
> > >> Keep us posted on the results.
> > >>
> > >> JM
> > >>
> > >>
> > >> 2013/12/9 Federico Gaule <[EMAIL PROTECTED]>
> > >>
> > >> > Default value for hbase.regionserver.replication.handler.count
> (can't
> > >> find
> > >> > what is the default, Is it 3?)
> > >> > I'll do a try increasing that property
> > >> >
> > >> > Fri Dec 06 12:44:12 EST 2013REPL IPC Server handler 2 on
> 60020WAITING
> > >> > (since 8sec ago)Waiting for a call (since 8sec ago)Fri Dec 06
> 12:44:12
> > >> EST
> > >> > 2013REPL IPC Server handler 1 on 60020WAITING (since 8sec
> ago)Waiting
> > >> for a
> > >> > call (since 8sec ago)Fri Dec 06 12:44:12 EST 2013REPL IPC Server
> > >> handler 0
> > >> > on 60020WAITING (since 2sec ago)Waiting for a call (since 2sec ago)
> > >> > Thanks JM
> > >> >
> > >> >
> > >> > 2013/12/9 Jean-Marc Spaggiari <[EMAIL PROTECTED]>
> > >> >
> > >> > > For replications, the handlers used on the salve cluster are
> > >> configured
> > >> > by
> > >> > > hbase.regionserver.replication.handler.count. What value do you
> have
> > >> for
> > >> > > this property?
> > >> > >
> > >> > > JM
> > >> > >
> > >> > >
> > >> > > 2013/12/9 Federico Gaule <[EMAIL PROTECTED]>
> > >> > >
> > >> > > > Here is a thread saying what i think it should be (
> > >> > > >
> > http://grokbase.com/t/hbase/user/13bmndq53k/average-rpc-queue-time)
> > >> > > >
> > >> > > > "The RpcQueueTime metrics are a measurement of how long
> individual
> > >> > calls
> > >> > > > stay in this queued state. If your handlers were never 100%
> > >> occupied,
> > >> > > this
> > >> > > > value would be 0. An average of 3 hours is concerning, it
[image: http://www.despegar.com/galeria/images/promos/isodespegar1.png]

*Ing. Federico Gaule*
Líder Técnico - PAM <[EMAIL PROTECTED]>
Av. Corrientes 746 - Piso 9 - C.A.B.A. (C1043AAU)
tel. +54 (11) 4894-3500

*[image: Seguinos en Twitter!] <http://twitter.com/#!/despegarar> [image:
Seguinos en Facebook!] <http://www.facebook.com/despegar> [image: Seguinos
en YouTube!] <http://www.youtube.com/Despegar>*
*Despegar.com, Inc. *
El mejor precio para tu viaje.

Este mensaje es confidencial y puede contener información amparada por el
secreto profesional.
Si usted ha recibido este e-mail por error, por favor comuníquenoslo
inmediatamente respondiendo a este e-mail y luego eliminándolo de su
sistema.
El contenido de este mensaje no deberá ser copiado ni divulgado a ninguna
persona.
+
Jean-Marc Spaggiari 2013-12-10, 13:58
+
Federico Gaule 2013-12-10, 14:26
+
Jean-Marc Spaggiari 2013-12-10, 14:46
+
Federico Gaule 2013-12-10, 17:31
+
Jean-Marc Spaggiari 2013-12-10, 17:42
+
Federico Gaule 2013-12-10, 18:21
+
Jean-Marc Spaggiari 2013-12-10, 18:43
+
Andrew Purtell 2013-12-10, 18:42
+
Federico Gaule 2013-12-10, 19:00