Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase, mail # dev - precommit exception when opening HFiles.
lars hofhansl
2013-01-16, 23:02
Ted Yu
2013-01-16, 23:07
Andrew Purtell
2013-01-16, 23:16
Stack
2013-01-16, 23:17
Ted Yu
2013-01-16, 23:20
Andrew Purtell
2013-01-16, 23:23
lars hofhansl
2013-01-16, 23:25
Stack
2013-01-16, 23:26
Ted Yu
2013-01-16, 23:28
Andrew Purtell
2013-01-16, 23:29
Ted Yu
2013-01-16, 23:36
Andrew Purtell
2013-01-16, 23:37
lars hofhansl
2013-01-16, 23:47
Andrew Purtell
2013-01-17, 00:20
Copy link to this message
-
Re: precommit exception when opening HFiles.
Andrew Purtell 2013-01-16, 23:28
Two theories:

1) There is junk in /tmp/hbase-${user.name} from an earlier test picked up
by the build.

2) This is something specific to the JRE version or the local environment
on hadoopqa.

I think Ted updated the precommit build config to rm -rf /tmp/hbase-* ahead
of testing.

For the second, it could be useful to dump out uname -a and java -version
ahead of running the build?
On Wed, Jan 16, 2013 at 3:17 PM, Stack <[EMAIL PROTECTED]> wrote:

> Easy enough to test by running a patch by hadoopqa?  TestLocalHBaseCluster
> is failing w/ the above most of the time?
>
> Good on you,
> St.Ack
>
>
> On Wed, Jan 16, 2013 at 3:07 PM, Ted Yu <[EMAIL PROTECTED]> wrote:
>
> > For TestLocalHBaseCluster test failure, the only explanation I can come
> up
> > with is that in deserializeFromWritable(), majorVersion was <= 1. This
> > would result in comparatorClassName not assigned (to concrete comparator
> > classname) due to the following check (line 366):
> >
> >     if (majorVersion > 1) {
> >
> > Cheers
> >
> > On Wed, Jan 16, 2013 at 3:02 PM, lars hofhansl <[EMAIL PROTECTED]> wrote:
> >
> > > In some of the failed test logs in trunk precommit I see these.
> > > Look bad. Is that something to worry about?
> > >
> > >
> > > java.io.IOException: java.io.IOException: java.io.IOException:
> > > java.lang.InstantiationException: org.apache.hadoop.io.RawComparator
> > >     at
> > >
> >
> org.apache.hadoop.hbase.regionserver.HRegion.initializeRegionInternals(HRegion.java:612)
> > >     at
> > >
> org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:533)
> > >     at
> > >
> >
> org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4086)
> > >     at
> > >
> >
> org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4036)
> > >     at
> > >
> >
> org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.openRegion(OpenRegionHandler.java:427)
> > >     at
> > >
> >
> org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.process(OpenRegionHandler.java:130)
> > >     at
> > >
> org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:202)
> > >     at
> > >
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> > >     at
> > >
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> > >     at java.lang.Thread.run(Thread.java:662)
> > > Caused by: java.io.IOException: java.io.IOException:
> > > java.lang.InstantiationException: org.apache.hadoop.io.RawComparator
> > >     at
> > >
> >
> org.apache.hadoop.hbase.regionserver.HStore.loadStoreFiles(HStore.java:450)
> > >     at
> > org.apache.hadoop.hbase.regionserver.HStore.<init>(HStore.java:215)
> > >     at
> > >
> >
> org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:3060)
> > >     at
> > > org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:585)
> > >     at
> > > org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:583)
> > >     at
> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> > >     at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> > >     at
> > > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
> > >     at
> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> > >     at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> > >     ... 3 more
> > > Caused by: java.io.IOException: java.lang.InstantiationException:
> > > org.apache.hadoop.io.RawComparator
> > >     at
> > >
> >
> org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.createComparator(FixedFileTrailer.java:607)
> > >     at
> > >
> >
> org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.createComparator(FixedFileTrailer.java:615)
> > >     at
> > >
> >
> org.apache.hadoop.hbase.io.hfile.HFileReaderV2.<init>(HFileReaderV2.java:115)
> > >     at
> > >
> org.apache.hadoop.hbase.io.hfile.HFile.pickReaderVersion(HFile.java:564)
> > >     at
> > >
> >
> org.apache.hadoop.hbase.io.hfile.HFile.createReaderWithEncoding(HFile.java:599)

Best regards,

   - Andy

Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)