Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase, mail # dev - precommit exception when opening HFiles.


+
lars hofhansl 2013-01-16, 23:02
+
Ted Yu 2013-01-16, 23:07
+
Stack 2013-01-16, 23:17
+
Andrew Purtell 2013-01-16, 23:28
Copy link to this message
-
Re: precommit exception when opening HFiles.
Ted Yu 2013-01-16, 23:36
>From https://builds.apache.org/job/PreCommit-HBASE-Build/4057/consoleFull :
[PreCommit-HBASE-Build] $ /bin/bash
/tmp/hudson2696208886865701786.shasf002.sp2.ygridcore.net
Linux asf002.sp2.ygridcore.net 2.6.32-33-server #71-Ubuntu SMP Wed Jul
20 17:42:25 UTC 2011 x86_64 GNU/Linux
core file size          (blocks, -c) 0
data seg size           (kbytes, -d) unlimited
scheduling priority             (-e) 20
file size               (blocks, -f) unlimited
pending signals                 (-i) 16382
max locked memory       (kbytes, -l) 64
max memory size         (kbytes, -m) unlimited
open files                      (-n) 60000
pipe size            (512 bytes, -p) 8
POSIX message queues     (bytes, -q) 819200
real-time priority              (-r) 0
stack size              (kbytes, -s) 8192
cpu time               (seconds, -t) unlimited
max user processes              (-u) 10240
virtual memory          (kbytes, -v) unlimited
file locks                      (-x) unlimited
60000
Running in Jenkins mode
I added 'java -version' to the above list - effective in next build.
Jenkins says Java 1.7 latest
Cheers
On Wed, Jan 16, 2013 at 3:28 PM, Andrew Purtell <[EMAIL PROTECTED]> wrote:

> Two theories:
>
> 1) There is junk in /tmp/hbase-${user.name} from an earlier test picked up
> by the build.
>
> 2) This is something specific to the JRE version or the local environment
> on hadoopqa.
>
> I think Ted updated the precommit build config to rm -rf /tmp/hbase-* ahead
> of testing.
>
> For the second, it could be useful to dump out uname -a and java -version
> ahead of running the build?
>
>
> On Wed, Jan 16, 2013 at 3:17 PM, Stack <[EMAIL PROTECTED]> wrote:
>
> > Easy enough to test by running a patch by hadoopqa?
>  TestLocalHBaseCluster
> > is failing w/ the above most of the time?
> >
> > Good on you,
> > St.Ack
> >
> >
> > On Wed, Jan 16, 2013 at 3:07 PM, Ted Yu <[EMAIL PROTECTED]> wrote:
> >
> > > For TestLocalHBaseCluster test failure, the only explanation I can come
> > up
> > > with is that in deserializeFromWritable(), majorVersion was <= 1. This
> > > would result in comparatorClassName not assigned (to concrete
> comparator
> > > classname) due to the following check (line 366):
> > >
> > >     if (majorVersion > 1) {
> > >
> > > Cheers
> > >
> > > On Wed, Jan 16, 2013 at 3:02 PM, lars hofhansl <[EMAIL PROTECTED]>
> wrote:
> > >
> > > > In some of the failed test logs in trunk precommit I see these.
> > > > Look bad. Is that something to worry about?
> > > >
> > > >
> > > > java.io.IOException: java.io.IOException: java.io.IOException:
> > > > java.lang.InstantiationException: org.apache.hadoop.io.RawComparator
> > > >     at
> > > >
> > >
> >
> org.apache.hadoop.hbase.regionserver.HRegion.initializeRegionInternals(HRegion.java:612)
> > > >     at
> > > >
> > org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:533)
> > > >     at
> > > >
> > >
> >
> org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4086)
> > > >     at
> > > >
> > >
> >
> org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4036)
> > > >     at
> > > >
> > >
> >
> org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.openRegion(OpenRegionHandler.java:427)
> > > >     at
> > > >
> > >
> >
> org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.process(OpenRegionHandler.java:130)
> > > >     at
> > > >
> > org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:202)
> > > >     at
> > > >
> > >
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> > > >     at
> > > >
> > >
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> > > >     at java.lang.Thread.run(Thread.java:662)
> > > > Caused by: java.io.IOException: java.io.IOException:
> > > > java.lang.InstantiationException: org.apache.hadoop.io.RawComparator
> > > >     at
> > > >
> > >
> >
> org.apache.hadoop.hbase.regionserver.HStore.loadStoreFiles(HStore.java:450)
+
Andrew Purtell 2013-01-16, 23:37
+
Ted Yu 2013-01-16, 23:20
+
lars hofhansl 2013-01-16, 23:25
+
Andrew Purtell 2013-01-16, 23:23
+
Andrew Purtell 2013-01-16, 23:16
+
Stack 2013-01-16, 23:26
+
Ted Yu 2013-01-16, 23:28
+
lars hofhansl 2013-01-16, 23:47
+
Andrew Purtell 2013-01-17, 00:20
+
Andrew Purtell 2013-01-16, 23:29