Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase, mail # dev - precommit exception when opening HFiles.


+
lars hofhansl 2013-01-16, 23:02
+
Ted Yu 2013-01-16, 23:07
+
Stack 2013-01-16, 23:17
+
Andrew Purtell 2013-01-16, 23:28
+
Ted Yu 2013-01-16, 23:36
+
Andrew Purtell 2013-01-16, 23:37
+
Ted Yu 2013-01-16, 23:20
Copy link to this message
-
Re: precommit exception when opening HFiles.
lars hofhansl 2013-01-16, 23:25
Yep, that's what made me curious and I checked the log files.
As Andy said, there's no good explanation for that exception.

The class does still exist in Hadoop trunk. And it is very curious that it only fails sometimes.

-- Lars
________________________________
 From: Ted Yu <[EMAIL PROTECTED]>
To: [EMAIL PROTECTED]
Sent: Wednesday, January 16, 2013 3:20 PM
Subject: Re: precommit exception when opening HFiles.
 
TestLocalHBaseCluster fails quite often in PreCommit builds
e.g.
https://builds.apache.org/job/PreCommit-HBASE-Build/4056/testReport/

Cheers

On Wed, Jan 16, 2013 at 3:17 PM, Stack <[EMAIL PROTECTED]> wrote:

> Easy enough to test by running a patch by hadoopqa?  TestLocalHBaseCluster
> is failing w/ the above most of the time?
>
> Good on you,
> St.Ack
>
>
> On Wed, Jan 16, 2013 at 3:07 PM, Ted Yu <[EMAIL PROTECTED]> wrote:
>
> > For TestLocalHBaseCluster test failure, the only explanation I can come
> up
> > with is that in deserializeFromWritable(), majorVersion was <= 1. This
> > would result in comparatorClassName not assigned (to concrete comparator
> > classname) due to the following check (line 366):
> >
> >     if (majorVersion > 1) {
> >
> > Cheers
> >
> > On Wed, Jan 16, 2013 at 3:02 PM, lars hofhansl <[EMAIL PROTECTED]> wrote:
> >
> > > In some of the failed test logs in trunk precommit I see these.
> > > Look bad. Is that something to worry about?
> > >
> > >
> > > java.io.IOException: java.io.IOException: java.io.IOException:
> > > java.lang.InstantiationException: org.apache.hadoop.io.RawComparator
> > >     at
> > >
> >
> org.apache.hadoop.hbase.regionserver.HRegion.initializeRegionInternals(HRegion.java:612)
> > >     at
> > >
> org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:533)
> > >     at
> > >
> >
> org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4086)
> > >     at
> > >
> >
> org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4036)
> > >     at
> > >
> >
> org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.openRegion(OpenRegionHandler.java:427)
> > >     at
> > >
> >
> org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.process(OpenRegionHandler.java:130)
> > >     at
> > >
> org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:202)
> > >     at
> > >
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> > >     at
> > >
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> > >     at java.lang.Thread.run(Thread.java:662)
> > > Caused by: java.io.IOException: java.io.IOException:
> > > java.lang.InstantiationException: org.apache.hadoop.io.RawComparator
> > >     at
> > >
> >
> org.apache.hadoop.hbase.regionserver.HStore.loadStoreFiles(HStore.java:450)
> > >     at
> > org.apache.hadoop.hbase.regionserver.HStore.<init>(HStore.java:215)
> > >     at
> > >
> >
> org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:3060)
> > >     at
> > > org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:585)
> > >     at
> > > org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:583)
> > >     at
> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> > >     at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> > >     at
> > > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
> > >     at
> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> > >     at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> > >     ... 3 more
> > > Caused by: java.io.IOException: java.lang.InstantiationException:
> > > org.apache.hadoop.io.RawComparator
> > >     at
> > >
> >
> org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.createComparator(FixedFileTrailer.java:607)
> > >     at
> > >
> >
> org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.createComparator(FixedFileTrailer.java:615)
> > >     at
> > >
> >
> org.apache.hadoop.hbase.io.hfile.HFileReaderV2.<init>(HFileReaderV2.java:115)
+
Andrew Purtell 2013-01-16, 23:23
+
Andrew Purtell 2013-01-16, 23:16
+
Stack 2013-01-16, 23:26
+
Ted Yu 2013-01-16, 23:28
+
lars hofhansl 2013-01-16, 23:47
+
Andrew Purtell 2013-01-17, 00:20
+
Andrew Purtell 2013-01-16, 23:29