Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase >> mail # user >> Cleaner spamming log file


+
Robert Dyer 2013-01-28, 01:51
+
Ted Yu 2013-01-28, 02:21
+
Jean-Marc Spaggiari 2013-01-28, 02:28
Copy link to this message
-
Re: Cleaner spamming log file
Yes that does indeed look like my bug.  I guess I will upgrade to 0.94.4
then.  Thanks Jean-Marc and Ted!
On Sun, Jan 27, 2013 at 8:28 PM, Jean-Marc Spaggiari <
[EMAIL PROTECTED]> wrote:

> Indeed, it's related to both ;) You have the exception with is fixed
> by 7467 and the size of the logs which is fixed by 7214.
>
> Also, I will recommand you to disable the DEBUG level for this class
> if you can't migrate to 0.94.4
>
> JM
>
> 2013/1/27, Ted Yu <[EMAIL PROTECTED]>:
> > This should have been fixed by HBASE-7214 which is in 0.94.4
> >
> > Cheers
> >
> > On Sun, Jan 27, 2013 at 5:51 PM, Robert Dyer <[EMAIL PROTECTED]> wrote:
> >
> >> I noticed my HBase 0.94.3 master log was growing extremely large, then
> >> saw
> >> this repeated over and over.  Any ideas what is wrong here?  Should I
> >> just
> >> remove the /hbase/.archive directory for this table?
> >>
> >> (note: I changed sensitive host/table names, and the 'checking
> directory'
> >> line seems to exist once per region, omitting most here)
> >>
> >> 2013-01-27 19:44:52,337 DEBUG
> >> org.apache.hadoop.hbase.master.cleaner.CleanerChore: Checking directory:
> >>
> >>
> hdfs://XXXX:8020/hbase/.archive/XXXTABLEXXX/efffadf06a01127d476e378b8c9b73ce
> >> 2013-01-27 19:44:52,337 DEBUG
> >> org.apache.hadoop.hbase.master.cleaner.CleanerChore: Checking directory:
> >>
> >>
> hdfs://XXXX:8020/hbase/.archive/XXXTABLEXXX/f013601d853d9dc0c4d8d951843cae7d
> >> 2013-01-27 19:44:52,338 DEBUG
> >> org.apache.hadoop.hbase.master.cleaner.CleanerChore: Checking directory:
> >>
> >>
> hdfs://XXXX:8020/hbase/.archive/XXXTABLEXXX/f49e788d91e487ccaa5e772c49f48fd3
> >> 2013-01-27 19:44:52,338 DEBUG
> >> org.apache.hadoop.hbase.master.cleaner.CleanerChore: Checking directory:
> >>
> >>
> hdfs://XXXX:8020/hbase/.archive/XXXTABLEXXX/f58e3c8b336b692100a139b5d73f702a
> >> 2013-01-27 19:44:52,338 DEBUG
> >> org.apache.hadoop.hbase.master.cleaner.CleanerChore: Checking directory:
> >>
> >>
> hdfs://XXXX:8020/hbase/.archive/XXXTABLEXXX/f6acbb1629c7646ce2d1181e92d2a0ad
> >> 2013-01-27 19:44:52,339 DEBUG
> >> org.apache.hadoop.hbase.master.cleaner.CleanerChore: Checking directory:
> >>
> >>
> hdfs://XXXX:8020/hbase/.archive/XXXTABLEXXX/f8b28256870ce1ec011ed679d5348788
> >> 2013-01-27 19:44:52,339 DEBUG
> >> org.apache.hadoop.hbase.master.cleaner.CleanerChore: Checking directory:
> >>
> >>
> hdfs://XXXX:8020/hbase/.archive/XXXTABLEXXX/fce83dceecc91452e11e1c75b8454145
> >> 2013-01-27 19:44:52,339 DEBUG
> >> org.apache.hadoop.hbase.master.cleaner.CleanerChore: Checking directory:
> >>
> >>
> hdfs://XXXX:8020/hbase/.archive/XXXTABLEXXX/fed2d047b5fb8684db6faa7ccc2be85d
> >> 2013-01-27 19:44:52,340 DEBUG
> >> org.apache.hadoop.hbase.master.cleaner.CleanerChore: Checking directory:
> >>
> >>
> hdfs://XXXX:8020/hbase/.archive/XXXTABLEXXX/ff811b3e22145d22c2341bcaaadb0e4a
> >> 2013-01-27 19:44:52,341 WARN
> >> org.apache.hadoop.hbase.master.cleaner.CleanerChore: Error while
> cleaning
> >> the logs
> >> java.io.IOException: java.io.IOException: /hbase/.archive/XXXTABLEXXX is
> >> non empty
> >>         at
> >>
> >>
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:1972)
> >>         at
> >>
> org.apache.hadoop.hdfs.server.namenode.NameNode.delete(NameNode.java:792)
> >>         at sun.reflect.GeneratedMethodAccessor488.invoke(Unknown Source)
> >>         at
> >>
> >>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> >>         at java.lang.reflect.Method.invoke(Method.java:601)
> >>         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:563)
> >>         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1388)
> >>         at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1384)
> >>         at java.security.AccessController.doPrivileged(Native Method)
> >>         at javax.security.auth.Subject.doAs(Subject.java:415)
> >>         at
> >>
> >>
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
Robert Dyer
[EMAIL PROTECTED]
+
Jean-Marc Spaggiari 2013-01-28, 02:21
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB