Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase >> mail # user >> Region server going down when deleting a table from HBase


+
Sandeep L 2013-07-11, 13:08
+
Anoop John 2013-07-11, 13:17
+
Sandeep L 2013-07-11, 13:24
Copy link to this message
-
Re: Region server going down when deleting a table from HBase
After the flush opening the HFile reader. You are getting
FileNotFoundException!
*

LOG*.warn("Unable to rename " + path + " to " + dstPath);

Do you see above warn in log?

In code I can see even if this rename got failed we try to open the file
for read.   Also as part  of the region close, if we do a flush, we might
not really do the file open. It will be an unwanted input stream open.
Some one correct me if I am wrong pls.
-Anoop-

On Thu, Jul 11, 2013 at 6:54 PM, Sandeep L <[EMAIL PROTECTED]>wrote:

> Anoop,
> Following is stack trace
> ERROR org.apache.hadoop.hbase.executor.EventHandler: Caught throwable
> while processing event M_RS_CLOSE_REGIONjava.lang.RuntimeException:
> org.apache.hadoop.hbase.DroppedSnapshotException: region:
> TableName,better,1372421736221.55b13dd9eb08790e8e93757910209c21.        at
> org.apache.hadoop.hbase.regionserver.handler.CloseRegionHandler.process(CloseRegionHandler.java:133)
>        at
> org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:169)
>      at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>        at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>        at java.lang.Thread.run(Thread.java:722)Caused by:
> org.apache.hadoop.hbase.DroppedSnapshotException: region:
> TableName,better,1372421736221.55b13dd9eb08790e8e93757910209c21.        at
> org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:1474)
>        at
> org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:1353)
>        at
> org.apache.hadoop.hbase.regionserver.HRegion.doClose(HRegion.java:905)
>    at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:845)
>        at
> org.apache.hadoop.hbase.regionserver.handler.CloseRegionHandler.process(CloseRegionHandler.java:119)
>        ... 4 moreCaused by: java.io.FileNotFoundException: File does not
> exist:
> /hbase/TableName/55b13dd9eb08790e8e93757910209c21/WPA/ba8ae96c466f4559901127ca24378020
>        at
> org.apache.hadoop.hdfs.DFSClient$DFSInputStream.openInfo(DFSClient.java:1843)
>        at
> org.apache.hadoop.hdfs.DFSClient$DFSInputStream.<init>(DFSClient.java:1834)
>        at org.apache.hadoop.hdfs.DFSClient.open(DFSClient.java:578)
>  at
> org.apache.hadoop.hdfs.DistributedFileSystem.open(DistributedFileSystem.java:154)
>        at
> org.apache.hadoop.fs.FilterFileSystem.open(FilterFileSystem.java:108)
>  at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:427)        at
> org.apache.hadoop.hbase.io.hfile.HFile.createReaderWithEncoding(HFile.java:547)
>        at
> org.apache.hadoop.hbase.regionserver.StoreFile$Reader.<init>(StoreFile.java:1245)
>        at
> org.apache.hadoop.hbase.regionserver.StoreFile.open(StoreFile.java:512)
>    at
> org.apache.hadoop.hbase.regionserver.StoreFile.createReader(StoreFile.java:602)
>        at
> org.apache.hadoop.hbase.regionserver.Store.commitFile(Store.java:791)
>  at org.apache.hadoop.hbase.regionserver.Store.access$500(Store.java:108)
>      at
> org.apache.hadoop.hbase.regionserver.Store$StoreFlusherImpl.commit(Store.java:2256)
>        at
> org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:1455)
>        ... 8 more
> INFO org.apache.hadoop.ipc.HBaseServer: Stopping server on 60020
> Thanks,Sandeep.
>
> > Date: Thu, 11 Jul 2013 18:47:17 +0530
> > Subject: Re: Region server going down when deleting a table from HBase
> > From: [EMAIL PROTECTED]
> > To: [EMAIL PROTECTED]
>  >
> > What is the full trace for DroppedSnapshotException ?  The caused by
> trace?
> >
> > -Anoop-
> >
> > On Thu, Jul 11, 2013 at 6:38 PM, Sandeep L <[EMAIL PROTECTED]
> >wrote:
> >
> > > Hi,
> > > We are using hbase-0.94.1 with hadoop-1.0.2.
> > > Recently couple of time we faced a strange issue while deleting a
> table.
> > > Whenever we are deleting a table from HBase shell using disable and
> drop
> > > command at least one or two region servers are going down suddenly.
+
Anoop John 2013-07-11, 14:39
+
ramkrishna vasudevan 2013-07-11, 16:08
+
Ted Yu 2013-07-11, 14:31