Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase >> mail # user >> HBase Region Server Spinning on JMX requests


+
Buckley,Ron 2013-04-23, 13:57
Copy link to this message
-
Re: HBase Region Server Spinning on JMX requests
Hmm... That's not good. Would you mind filing a ticket here: https://issues.apache.org/jira/browse/HBASE ?

-- Lars
________________________________
 From: "Buckley,Ron" <[EMAIL PROTECTED]>
To: [EMAIL PROTECTED]
Sent: Tuesday, April 23, 2013 6:57 AM
Subject: HBase Region Server Spinning on JMX requests
 

This is with HBase 0.94.4 & CDH 4.1.1

This morning one our region servers (we have 44) stopped responding to
the '/jmx' request. (It's working for regular activity.)  Additionally,
the region server is now using all the CPU on the host, running all 8
cores at 100%.

I've got several jstacks, they all look like this:
http://pastebin.com/dGTmTEN7

If I do a wget of the /jmx url, it starts responding, but never
completes, always stopping at the same point:
http://pastebin.com/qhNvxrQK

Has anyone ever seen this before? If so, Is there a way out of it?
(other than bouncing the region server).

BTW: There's nothing relevant in the region server log and the garbage
collector log is normal.
----------------------------------------------------------------------
Ron Buckley
+
Kevin Odell 2013-04-24, 03:04
+
Buckley,Ron 2013-04-24, 11:37
+
Andrew Purtell 2013-04-24, 16:31
+
Elliott Clark 2013-04-24, 18:29