Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase >> mail # user >> Region server going down when deleting a table from HBase


+
Sandeep L 2013-07-11, 13:08
+
Anoop John 2013-07-11, 13:17
+
Sandeep L 2013-07-11, 13:24
+
Anoop John 2013-07-11, 14:37
+
Anoop John 2013-07-11, 14:39
+
ramkrishna vasudevan 2013-07-11, 16:08
Copy link to this message
-
Re: Region server going down when deleting a table from HBase
bq. Caused by: java.io.FileNotFoundException: File does not exist:
/hbase/TableName/55b13dd9eb08790e8e93757910209c21/WPA/
ba8ae96c466f4559901127ca24378020

Can you check in region server / namenode logs how the above file got
deleted ?

On Thu, Jul 11, 2013 at 6:24 AM, Sandeep L <[EMAIL PROTECTED]>wrote:

> Anoop,
> Following is stack trace
> ERROR org.apache.hadoop.hbase.executor.EventHandler: Caught throwable
> while processing event M_RS_CLOSE_REGIONjava.lang.RuntimeException:
> org.apache.hadoop.hbase.DroppedSnapshotException: region:
> TableName,better,1372421736221.55b13dd9eb08790e8e93757910209c21.        at
> org.apache.hadoop.hbase.regionserver.handler.CloseRegionHandler.process(CloseRegionHandler.java:133)
>        at
> org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:169)
>      at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>        at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>        at java.lang.Thread.run(Thread.java:722)Caused by:
> org.apache.hadoop.hbase.DroppedSnapshotException: region:
> TableName,better,1372421736221.55b13dd9eb08790e8e93757910209c21.        at
> org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:1474)
>        at
> org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:1353)
>        at
> org.apache.hadoop.hbase.regionserver.HRegion.doClose(HRegion.java:905)
>    at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:845)
>        at
> org.apache.hadoop.hbase.regionserver.handler.CloseRegionHandler.process(CloseRegionHandler.java:119)
>        ... 4 moreCaused by: java.io.FileNotFoundException: File does not
> exist:
> /hbase/TableName/55b13dd9eb08790e8e93757910209c21/WPA/ba8ae96c466f4559901127ca24378020
>        at
> org.apache.hadoop.hdfs.DFSClient$DFSInputStream.openInfo(DFSClient.java:1843)
>        at
> org.apache.hadoop.hdfs.DFSClient$DFSInputStream.<init>(DFSClient.java:1834)
>        at org.apache.hadoop.hdfs.DFSClient.open(DFSClient.java:578)
>  at
> org.apache.hadoop.hdfs.DistributedFileSystem.open(DistributedFileSystem.java:154)
>        at
> org.apache.hadoop.fs.FilterFileSystem.open(FilterFileSystem.java:108)
>  at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:427)        at
> org.apache.hadoop.hbase.io.hfile.HFile.createReaderWithEncoding(HFile.java:547)
>        at
> org.apache.hadoop.hbase.regionserver.StoreFile$Reader.<init>(StoreFile.java:1245)
>        at
> org.apache.hadoop.hbase.regionserver.StoreFile.open(StoreFile.java:512)
>    at
> org.apache.hadoop.hbase.regionserver.StoreFile.createReader(StoreFile.java:602)
>        at
> org.apache.hadoop.hbase.regionserver.Store.commitFile(Store.java:791)
>  at org.apache.hadoop.hbase.regionserver.Store.access$500(Store.java:108)
>      at
> org.apache.hadoop.hbase.regionserver.Store$StoreFlusherImpl.commit(Store.java:2256)
>        at
> org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:1455)
>        ... 8 more
> INFO org.apache.hadoop.ipc.HBaseServer: Stopping server on 60020
> Thanks,Sandeep.
>
> > Date: Thu, 11 Jul 2013 18:47:17 +0530
> > Subject: Re: Region server going down when deleting a table from HBase
> > From: [EMAIL PROTECTED]
> > To: [EMAIL PROTECTED]
> >
> > What is the full trace for DroppedSnapshotException ?  The caused by
> trace?
> >
> > -Anoop-
> >
> > On Thu, Jul 11, 2013 at 6:38 PM, Sandeep L <[EMAIL PROTECTED]
> >wrote:
> >
> > > Hi,
> > > We are using hbase-0.94.1 with hadoop-1.0.2.
> > > Recently couple of time we faced a strange issue while deleting a
> table.
> > > Whenever we are deleting a table from HBase shell using disable and
> drop
> > > command at least one or two region servers are going down suddenly.
> > > I observed following error message in region server log:
> > > INFO org.apache.hadoop.hbase.regionserver.HRegionServer: STOPPED:
> > > Unrecoverable exception while closing region
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB