Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase >> mail # dev >> precommit exception when opening HFiles.


+
lars hofhansl 2013-01-16, 23:02
+
Ted Yu 2013-01-16, 23:07
+
Stack 2013-01-16, 23:17
+
Andrew Purtell 2013-01-16, 23:28
Copy link to this message
-
Re: precommit exception when opening HFiles.
>From https://builds.apache.org/job/PreCommit-HBASE-Build/4057/consoleFull :
[PreCommit-HBASE-Build] $ /bin/bash
/tmp/hudson2696208886865701786.shasf002.sp2.ygridcore.net
Linux asf002.sp2.ygridcore.net 2.6.32-33-server #71-Ubuntu SMP Wed Jul
20 17:42:25 UTC 2011 x86_64 GNU/Linux
core file size          (blocks, -c) 0
data seg size           (kbytes, -d) unlimited
scheduling priority             (-e) 20
file size               (blocks, -f) unlimited
pending signals                 (-i) 16382
max locked memory       (kbytes, -l) 64
max memory size         (kbytes, -m) unlimited
open files                      (-n) 60000
pipe size            (512 bytes, -p) 8
POSIX message queues     (bytes, -q) 819200
real-time priority              (-r) 0
stack size              (kbytes, -s) 8192
cpu time               (seconds, -t) unlimited
max user processes              (-u) 10240
virtual memory          (kbytes, -v) unlimited
file locks                      (-x) unlimited
60000
Running in Jenkins mode
I added 'java -version' to the above list - effective in next build.
Jenkins says Java 1.7 latest
Cheers
On Wed, Jan 16, 2013 at 3:28 PM, Andrew Purtell <[EMAIL PROTECTED]> wrote:

> Two theories:
>
> 1) There is junk in /tmp/hbase-${user.name} from an earlier test picked up
> by the build.
>
> 2) This is something specific to the JRE version or the local environment
> on hadoopqa.
>
> I think Ted updated the precommit build config to rm -rf /tmp/hbase-* ahead
> of testing.
>
> For the second, it could be useful to dump out uname -a and java -version
> ahead of running the build?
>
>
> On Wed, Jan 16, 2013 at 3:17 PM, Stack <[EMAIL PROTECTED]> wrote:
>
> > Easy enough to test by running a patch by hadoopqa?
>  TestLocalHBaseCluster
> > is failing w/ the above most of the time?
> >
> > Good on you,
> > St.Ack
> >
> >
> > On Wed, Jan 16, 2013 at 3:07 PM, Ted Yu <[EMAIL PROTECTED]> wrote:
> >
> > > For TestLocalHBaseCluster test failure, the only explanation I can come
> > up
> > > with is that in deserializeFromWritable(), majorVersion was <= 1. This
> > > would result in comparatorClassName not assigned (to concrete
> comparator
> > > classname) due to the following check (line 366):
> > >
> > >     if (majorVersion > 1) {
> > >
> > > Cheers
> > >
> > > On Wed, Jan 16, 2013 at 3:02 PM, lars hofhansl <[EMAIL PROTECTED]>
> wrote:
> > >
> > > > In some of the failed test logs in trunk precommit I see these.
> > > > Look bad. Is that something to worry about?
> > > >
> > > >
> > > > java.io.IOException: java.io.IOException: java.io.IOException:
> > > > java.lang.InstantiationException: org.apache.hadoop.io.RawComparator
> > > >     at
> > > >
> > >
> >
> org.apache.hadoop.hbase.regionserver.HRegion.initializeRegionInternals(HRegion.java:612)
> > > >     at
> > > >
> > org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:533)
> > > >     at
> > > >
> > >
> >
> org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4086)
> > > >     at
> > > >
> > >
> >
> org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4036)
> > > >     at
> > > >
> > >
> >
> org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.openRegion(OpenRegionHandler.java:427)
> > > >     at
> > > >
> > >
> >
> org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.process(OpenRegionHandler.java:130)
> > > >     at
> > > >
> > org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:202)
> > > >     at
> > > >
> > >
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> > > >     at
> > > >
> > >
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> > > >     at java.lang.Thread.run(Thread.java:662)
> > > > Caused by: java.io.IOException: java.io.IOException:
> > > > java.lang.InstantiationException: org.apache.hadoop.io.RawComparator
> > > >     at
> > > >
> > >
> >
> org.apache.hadoop.hbase.regionserver.HStore.loadStoreFiles(HStore.java:450)
+
Andrew Purtell 2013-01-16, 23:37
+
Ted Yu 2013-01-16, 23:20
+
lars hofhansl 2013-01-16, 23:25
+
Andrew Purtell 2013-01-16, 23:23
+
Andrew Purtell 2013-01-16, 23:16
+
Stack 2013-01-16, 23:26
+
Ted Yu 2013-01-16, 23:28
+
lars hofhansl 2013-01-16, 23:47
+
Andrew Purtell 2013-01-17, 00:20
+
Andrew Purtell 2013-01-16, 23:29
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB