Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase, mail # user - Region server going down when deleting a table from HBase


Copy link to this message
-
Re: Region server going down when deleting a table from HBase
ramkrishna vasudevan 2013-07-11, 16:08
Yes it creates the reader and then deletes the reader if the rename fails.
On Thu, Jul 11, 2013 at 8:09 PM, Anoop John <[EMAIL PROTECTED]> wrote:

> Ya as Ted said, if this warn is not there, need to see what happened
> to that file (just created)
>
> -Anoop-
>
> On Thu, Jul 11, 2013 at 8:07 PM, Anoop John <[EMAIL PROTECTED]> wrote:
>
> > After the flush opening the HFile reader. You are getting
> > FileNotFoundException!
> > *
> >
> > LOG
> > *.warn("Unable to rename " + path + " to " + dstPath);
> >
> > Do you see above warn in log?
> >
> > In code I can see even if this rename got failed we try to open the file
> > for read.   Also as part  of the region close, if we do a flush, we might
> > not really do the file open. It will be an unwanted input stream open.
> > Some one correct me if I am wrong pls.
> > -Anoop-
> >
> >  On Thu, Jul 11, 2013 at 6:54 PM, Sandeep L <[EMAIL PROTECTED]
> >wrote:
> >
> >> Anoop,
> >> Following is stack trace
> >> ERROR org.apache.hadoop.hbase.executor.EventHandler: Caught throwable
> >> while processing event M_RS_CLOSE_REGIONjava.lang.RuntimeException:
> >> org.apache.hadoop.hbase.DroppedSnapshotException: region:
> >> TableName,better,1372421736221.55b13dd9eb08790e8e93757910209c21.
>  at
> >>
> org.apache.hadoop.hbase.regionserver.handler.CloseRegionHandler.process(CloseRegionHandler.java:133)
> >>        at
> >> org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:169)
> >>      at
> >>
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
> >>        at
> >>
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
> >>        at java.lang.Thread.run(Thread.java:722)Caused by:
> >> org.apache.hadoop.hbase.DroppedSnapshotException: region:
> >> TableName,better,1372421736221.55b13dd9eb08790e8e93757910209c21.
>  at
> >>
> org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:1474)
> >>        at
> >>
> org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:1353)
> >>        at
> >> org.apache.hadoop.hbase.regionserver.HRegion.doClose(HRegion.java:905)
> >>    at
> org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:845)
> >>        at
> >>
> org.apache.hadoop.hbase.regionserver.handler.CloseRegionHandler.process(CloseRegionHandler.java:119)
> >>        ... 4 moreCaused by: java.io.FileNotFoundException: File does not
> >> exist:
> >>
> /hbase/TableName/55b13dd9eb08790e8e93757910209c21/WPA/ba8ae96c466f4559901127ca24378020
> >>        at
> >>
> org.apache.hadoop.hdfs.DFSClient$DFSInputStream.openInfo(DFSClient.java:1843)
> >>        at
> >>
> org.apache.hadoop.hdfs.DFSClient$DFSInputStream.<init>(DFSClient.java:1834)
> >>        at org.apache.hadoop.hdfs.DFSClient.open(DFSClient.java:578)
> >>  at
> >>
> org.apache.hadoop.hdfs.DistributedFileSystem.open(DistributedFileSystem.java:154)
> >>        at
> >> org.apache.hadoop.fs.FilterFileSystem.open(FilterFileSystem.java:108)
> >>  at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:427)        at
> >>
> org.apache.hadoop.hbase.io.hfile.HFile.createReaderWithEncoding(HFile.java:547)
> >>        at
> >>
> org.apache.hadoop.hbase.regionserver.StoreFile$Reader.<init>(StoreFile.java:1245)
> >>        at
> >> org.apache.hadoop.hbase.regionserver.StoreFile.open(StoreFile.java:512)
> >>    at
> >>
> org.apache.hadoop.hbase.regionserver.StoreFile.createReader(StoreFile.java:602)
> >>        at
> >> org.apache.hadoop.hbase.regionserver.Store.commitFile(Store.java:791)
> >>  at
> org.apache.hadoop.hbase.regionserver.Store.access$500(Store.java:108)
> >>      at
> >>
> org.apache.hadoop.hbase.regionserver.Store$StoreFlusherImpl.commit(Store.java:2256)
> >>        at
> >>
> org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:1455)
> >>        ... 8 more
> >> INFO org.apache.hadoop.ipc.HBaseServer: Stopping server on 60020
> >> Thanks,Sandeep.
> >>
> >> > Date: Thu, 11 Jul 2013 18:47:17 +0530