Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase >> mail # user >> RPC - Queue Time when handlers are all waiting


+
Federico Gaule 2013-12-05, 12:49
+
Federico Gaule 2013-12-07, 15:22
+
Bharath Vissapragada 2013-12-07, 15:33
+
Federico Gaule 2013-12-09, 13:18
+
Jean-Marc Spaggiari 2013-12-09, 13:55
+
Federico Gaule 2013-12-09, 14:13
+
Jean-Marc Spaggiari 2013-12-09, 14:30
+
Federico Gaule 2013-12-09, 14:46
+
Federico Gaule 2013-12-09, 15:07
+
Jean-Marc Spaggiari 2013-12-09, 15:35
+
Federico Gaule 2013-12-09, 15:48
+
Jean-Marc Spaggiari 2013-12-09, 15:53
+
Federico Gaule 2013-12-10, 12:05
+
Federico Gaule 2013-12-10, 12:21
+
Nicolas Liochon 2013-12-10, 12:59
Copy link to this message
-
Re: RPC - Queue Time when handlers are all waiting
I'm using hbase 0.94.13.
hbase.regionserver.metahandler.count is a more intuituve name for those
handlers :)
2013/12/10 Nicolas Liochon <[EMAIL PROTECTED]>

> It's hbase.regionserver.metahandler.count. Not sure it causes the issue
> you're facing, thought. What's your HBase version?
>
>
> On Tue, Dec 10, 2013 at 1:21 PM, Federico Gaule <[EMAIL PROTECTED]>
> wrote:
>
> > There is another set of handler we haven't customized "PRI IPC" (priority
> > ?). What are those handlers used for? What is the property used to
> increase
> > the number of handlers? hbase.regionserver.custom.priority.handler.count
> ?
> >
> > Thanks!
> >
> >
> > 2013/12/10 Federico Gaule <[EMAIL PROTECTED]>
> >
> > > I've increased hbase.regionserver.replication.handler.count 10x (30)
> but
> > > nothing have changed. rpc.metrics.RpcQueueTime_avg_time still shows
> > > activity :(
> > >
> > > Mon Dec 09 14:04:10 EST 2013REPL IPC Server handler 29 on 60000 WAITING
> > > (since 16hrs, 58mins, 56sec ago)Waiting for a call (since 16hrs,
> 58mins,
> > > 56sec ago) Mon Dec 09 14:04:10 EST 2013 REPL IPC Server handler 28 on
> > > 60000WAITING (since 16hrs, 58mins, 56sec ago) Waiting for a call (since
> > > 16hrs, 58mins, 56sec ago)Mon Dec 09 14:04:10 EST 2013 REPL IPC Server
> > > handler 27 on 60000 WAITING (since 16hrs, 58mins, 56sec ago)Waiting
> for a
> > > call (since 16hrs, 58mins, 56sec ago) Mon Dec 09 14:04:10 EST 2013 REPL
> > > IPC Server handler 26 on 60000WAITING (since 16hrs, 58mins, 56sec
> > ago)Waiting for a call (since 16hrs, 58mins, 56sec ago)
> > > ... ...
> > > ...
> > > ...
> > > Mon Dec 09 14:04:10 EST 2013 REPL IPC Server handler 2 on 60000WAITING
> > > (since 16hrs, 58mins, 56sec ago) Waiting for a call (since 16hrs,
> 58mins,
> > > 56sec ago)Mon Dec 09 14:04:10 EST 2013 REPL IPC Server handler 1 on
> > 60000WAITING (since 16hrs, 58mins, 56sec ago)Waiting
> > > for a call (since 16hrs, 58mins, 56sec ago) Mon Dec 09 14:04:10 EST
> > 2013REPL IPC Server handler 0 on 60000WAITING
> > > (since 16hrs, 58mins, 56sec ago) Waiting for a call (since 16hrs,
> 58mins,
> > > 56sec ago)
> > > Thanks JM
> > >
> > >
> > > 2013/12/9 Jean-Marc Spaggiari <[EMAIL PROTECTED]>
> > >
> > >> Yes, default value is 3 in 0.94.14. If you have not changed it, then
> > it's
> > >> still 3.
> > >>
> > >> conf.getInt("hbase.regionserver.replication.handler.count", 3);
> > >>
> > >> Keep us posted on the results.
> > >>
> > >> JM
> > >>
> > >>
> > >> 2013/12/9 Federico Gaule <[EMAIL PROTECTED]>
> > >>
> > >> > Default value for hbase.regionserver.replication.handler.count
> (can't
> > >> find
> > >> > what is the default, Is it 3?)
> > >> > I'll do a try increasing that property
> > >> >
> > >> > Fri Dec 06 12:44:12 EST 2013REPL IPC Server handler 2 on
> 60020WAITING
> > >> > (since 8sec ago)Waiting for a call (since 8sec ago)Fri Dec 06
> 12:44:12
> > >> EST
> > >> > 2013REPL IPC Server handler 1 on 60020WAITING (since 8sec
> ago)Waiting
> > >> for a
> > >> > call (since 8sec ago)Fri Dec 06 12:44:12 EST 2013REPL IPC Server
> > >> handler 0
> > >> > on 60020WAITING (since 2sec ago)Waiting for a call (since 2sec ago)
> > >> > Thanks JM
> > >> >
> > >> >
> > >> > 2013/12/9 Jean-Marc Spaggiari <[EMAIL PROTECTED]>
> > >> >
> > >> > > For replications, the handlers used on the salve cluster are
> > >> configured
> > >> > by
> > >> > > hbase.regionserver.replication.handler.count. What value do you
> have
> > >> for
> > >> > > this property?
> > >> > >
> > >> > > JM
> > >> > >
> > >> > >
> > >> > > 2013/12/9 Federico Gaule <[EMAIL PROTECTED]>
> > >> > >
> > >> > > > Here is a thread saying what i think it should be (
> > >> > > >
> > http://grokbase.com/t/hbase/user/13bmndq53k/average-rpc-queue-time)
> > >> > > >
> > >> > > > "The RpcQueueTime metrics are a measurement of how long
> individual
> > >> > calls
> > >> > > > stay in this queued state. If your handlers were never 100%
> > >> occupied,
> > >> > > this
> > >> > > > value would be 0. An average of 3 hours is concerning, it
[image: http://www.despegar.com/galeria/images/promos/isodespegar1.png]

*Ing. Federico Gaule*
Líder Técnico - PAM <[EMAIL PROTECTED]>
Av. Corrientes 746 - Piso 9 - C.A.B.A. (C1043AAU)
tel. +54 (11) 4894-3500

*[image: Seguinos en Twitter!] <http://twitter.com/#!/despegarar> [image:
Seguinos en Facebook!] <http://www.facebook.com/despegar> [image: Seguinos
en YouTube!] <http://www.youtube.com/Despegar>*
*Despegar.com, Inc. *
El mejor precio para tu viaje.

Este mensaje es confidencial y puede contener información amparada por el
secreto profesional.
Si usted ha recibido este e-mail por error, por favor comuníquenoslo
inmediatamente respondiendo a este e-mail y luego eliminándolo de su
sistema.
El contenido de este mensaje no deberá ser copiado ni divulgado a ninguna
persona.
+
Jean-Marc Spaggiari 2013-12-10, 13:58
+
Federico Gaule 2013-12-10, 14:26
+
Jean-Marc Spaggiari 2013-12-10, 14:46
+
Federico Gaule 2013-12-10, 17:31
+
Jean-Marc Spaggiari 2013-12-10, 17:42
+
Federico Gaule 2013-12-10, 18:21
+
Jean-Marc Spaggiari 2013-12-10, 18:43
+
Andrew Purtell 2013-12-10, 18:42
+
Federico Gaule 2013-12-10, 19:00
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB