|
|
-
regionserver has too many "blcok' state
hua beatls 2013-01-05, 09:06
HI, we have large batch file to put in the hbase, but we have many 'block' state usring: jstack -F XXX(pid of regionserver), please see below: - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Compiled frame) - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Compiled frame) - java.util.concurrent.LinkedBlockingQueue.take() @bci=29, line=442 (Compiled frame) - java.util.concurrent.ThreadPoolExecutor.getTask() @bci=156, line=1043 (Interpreted frame) - java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker) @bci=17, line=1103 (Interpreted frame) - java.util.concurrent.ThreadPoolExecutor$Worker.run() @bci=5, line=603 (Interpreted frame) - java.lang.Thread.run() @bci=11, line=722 (Interpreted frame) Thread 13980: (state = BLOCKED) - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame) - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Compiled frame) - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Compiled frame) - java.util.concurrent.LinkedBlockingQueue.take() @bci=29, line=442 (Compiled frame) - java.util.concurrent.ThreadPoolExecutor.getTask() @bci=156, line=1043 (Interpreted frame) - java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker) @bci=17, line=1103 (Interpreted frame) - java.util.concurrent.ThreadPoolExecutor$Worker.run() @bci=5, line=603 (Interpreted frame) - java.lang.Thread.run() @bci=11, line=722 (Interpreted frame) Thread 13979: (state = BLOCKED) - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame) - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Compiled frame) - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Compiled frame) - java.util.concurrent.LinkedBlockingQueue.take() @bci=29, line=442 (Compiled frame) - java.util.concurrent.ThreadPoolExecutor.getTask() @bci=156, line=1043 (Interpreted frame) - java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker) @bci=17, line=1103 (Interpreted frame) - java.util.concurrent.ThreadPoolExecutor$Worker.run() @bci=5, line=603 (Interpreted frame) - java.lang.Thread.run() @bci=11, line=722 (Interpreted frame) Thread 12957: (state = BLOCKED) - java.lang.Object.wait(long) @bci=0 (Interpreted frame) - java.lang.Object.wait() @bci=2, line=503 (Interpreted frame) - org.apache.hadoop.hbase.regionserver.SplitLogWorker.taskLoop() @bci=153, line=205 (Interpreted frame) - org.apache.hadoop.hbase.regionserver.SplitLogWorker.run() @bci=220, line=165 (Interpreted frame) - java.lang.Thread.run() @bci=11, line=722 (Interpreted frame) Thread 12956: (state = BLOCKED) - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame) - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Interpreted frame) - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Interpreted frame) - java.util.concurrent.LinkedBlockingQueue.take() @bci=29, line=442 (Interpreted frame) - org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run() @bci=76, line
any suggestion for the error log?
Thanks! beatls
-
Re: regionserver has too many "blcok' state
Stack 2013-01-06, 05:00
Is there no progress being made in your update? Mind providing more data on version, where it is running, what the update is like, how big the cells are, how many regions and regionservers.
St.Ack On Sat, Jan 5, 2013 at 1:06 AM, hua beatls <[EMAIL PROTECTED]> wrote:
> HI, > we have large batch file to put in the hbase, but we have many 'block' > state usring: jstack -F XXX(pid of regionserver), please see below: > > > - java.util.concurrent.locks.LockSupport.park(java.lang.Object) > @bci=14, line=186 (Compiled frame) > - > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() > @bci=42, line=2043 (Compiled frame) > - java.util.concurrent.LinkedBlockingQueue.take() @bci=29, line=442 > (Compiled frame) > - java.util.concurrent.ThreadPoolExecutor.getTask() @bci=156, line=1043 > (Interpreted frame) > - > > java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker) > @bci=17, line=1103 (Interpreted frame) > - java.util.concurrent.ThreadPoolExecutor$Worker.run() @bci=5, line=603 > (Interpreted frame) > - java.lang.Thread.run() @bci=11, line=722 (Interpreted frame) > > > Thread 13980: (state = BLOCKED) > - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame) > - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, > line=186 (Compiled frame) > - > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() > @bci=42, line=2043 (Compiled frame) > - java.util.concurrent.LinkedBlockingQueue.take() @bci=29, line=442 > (Compiled frame) > - java.util.concurrent.ThreadPoolExecutor.getTask() @bci=156, line=1043 > (Interpreted frame) > - > > java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker) > @bci=17, line=1103 (Interpreted frame) > - java.util.concurrent.ThreadPoolExecutor$Worker.run() @bci=5, line=603 > (Interpreted frame) > - java.lang.Thread.run() @bci=11, line=722 (Interpreted frame) > > > Thread 13979: (state = BLOCKED) > - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame) > - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, > line=186 (Compiled frame) > - > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() > @bci=42, line=2043 (Compiled frame) > - java.util.concurrent.LinkedBlockingQueue.take() @bci=29, line=442 > (Compiled frame) > - java.util.concurrent.ThreadPoolExecutor.getTask() @bci=156, line=1043 > (Interpreted frame) > - > > java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker) > @bci=17, line=1103 (Interpreted frame) > - java.util.concurrent.ThreadPoolExecutor$Worker.run() @bci=5, line=603 > (Interpreted frame) > - java.lang.Thread.run() @bci=11, line=722 (Interpreted frame) > > > Thread 12957: (state = BLOCKED) > - java.lang.Object.wait(long) @bci=0 (Interpreted frame) > - java.lang.Object.wait() @bci=2, line=503 (Interpreted frame) > - org.apache.hadoop.hbase.regionserver.SplitLogWorker.taskLoop() @bci=153, > line=205 (Interpreted frame) > - org.apache.hadoop.hbase.regionserver.SplitLogWorker.run() @bci=220, > line=165 (Interpreted frame) > - java.lang.Thread.run() @bci=11, line=722 (Interpreted frame) > > > Thread 12956: (state = BLOCKED) > - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame) > - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, > line=186 (Interpreted frame) > - > > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() > @bci=42, line=2043 (Interpreted frame) > - java.util.concurrent.LinkedBlockingQueue.take() @bci=29, line=442 > (Interpreted frame) > - org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run() @bci=76, line > > any suggestion for the error log? > > Thanks! > beatls >
-
Re: regionserver has too many "blcok' state
lars hofhansl 2013-01-06, 07:53
Which block states are you referring to? All I see is handler threads waiting for work.
________________________________ From: hua beatls <[EMAIL PROTECTED]> To: [EMAIL PROTECTED] Sent: Saturday, January 5, 2013 1:06 AM Subject: regionserver has too many "blcok' state HI, we have large batch file to put in the hbase, but we have many 'block' state usring: jstack -F XXX(pid of regionserver), please see below: - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Compiled frame) - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Compiled frame) - java.util.concurrent.LinkedBlockingQueue.take() @bci=29, line=442 (Compiled frame) - java.util.concurrent.ThreadPoolExecutor.getTask() @bci=156, line=1043 (Interpreted frame) - java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker) @bci=17, line=1103 (Interpreted frame) - java.util.concurrent.ThreadPoolExecutor$Worker.run() @bci=5, line=603 (Interpreted frame) - java.lang.Thread.run() @bci=11, line=722 (Interpreted frame) Thread 13980: (state = BLOCKED) - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame) - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Compiled frame) - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Compiled frame) - java.util.concurrent.LinkedBlockingQueue.take() @bci=29, line=442 (Compiled frame) - java.util.concurrent.ThreadPoolExecutor.getTask() @bci=156, line=1043 (Interpreted frame) - java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker) @bci=17, line=1103 (Interpreted frame) - java.util.concurrent.ThreadPoolExecutor$Worker.run() @bci=5, line=603 (Interpreted frame) - java.lang.Thread.run() @bci=11, line=722 (Interpreted frame) Thread 13979: (state = BLOCKED) - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame) - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Compiled frame) - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Compiled frame) - java.util.concurrent.LinkedBlockingQueue.take() @bci=29, line=442 (Compiled frame) - java.util.concurrent.ThreadPoolExecutor.getTask() @bci=156, line=1043 (Interpreted frame) - java.util.concurrent.ThreadPoolExecutor.runWorker(java.util.concurrent.ThreadPoolExecutor$Worker) @bci=17, line=1103 (Interpreted frame) - java.util.concurrent.ThreadPoolExecutor$Worker.run() @bci=5, line=603 (Interpreted frame) - java.lang.Thread.run() @bci=11, line=722 (Interpreted frame) Thread 12957: (state = BLOCKED) - java.lang.Object.wait(long) @bci=0 (Interpreted frame) - java.lang.Object.wait() @bci=2, line=503 (Interpreted frame) - org.apache.hadoop.hbase.regionserver.SplitLogWorker.taskLoop() @bci=153, line=205 (Interpreted frame) - org.apache.hadoop.hbase.regionserver.SplitLogWorker.run() @bci=220, line=165 (Interpreted frame) - java.lang.Thread.run() @bci=11, line=722 (Interpreted frame) Thread 12956: (state = BLOCKED) - sun.misc.Unsafe.park(boolean, long) @bci=0 (Interpreted frame) - java.util.concurrent.locks.LockSupport.park(java.lang.Object) @bci=14, line=186 (Interpreted frame) - java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await() @bci=42, line=2043 (Interpreted frame) - java.util.concurrent.LinkedBlockingQueue.take() @bci=29, line=442 (Interpreted frame) - org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run() @bci=76, line
any suggestion for the error log?
Thanks! beatls
|
|