Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase, mail # dev - precommit exception when opening HFiles.


+
lars hofhansl 2013-01-16, 23:02
+
Ted Yu 2013-01-16, 23:07
+
Stack 2013-01-16, 23:17
+
Andrew Purtell 2013-01-16, 23:28
+
Ted Yu 2013-01-16, 23:36
+
Andrew Purtell 2013-01-16, 23:37
+
Ted Yu 2013-01-16, 23:20
+
lars hofhansl 2013-01-16, 23:25
+
Andrew Purtell 2013-01-16, 23:23
Copy link to this message
-
Re: precommit exception when opening HFiles.
Andrew Purtell 2013-01-16, 23:16
There's a default assignment of org.apache.hadoop.io.RawComparator for that
case, even if it were likely.

comparatorClassName is set to org.apache.hadoop.io.RawComparator. The
instantiation of this class is what is failing. The class can't be found.
 I've seen this sort of thing happen when jars are pulled out from under
the JVM. No idea what is really going on here.
On Wed, Jan 16, 2013 at 3:07 PM, Ted Yu <[EMAIL PROTECTED]> wrote:

> For TestLocalHBaseCluster test failure, the only explanation I can come up
> with is that in deserializeFromWritable(), majorVersion was <= 1. This
> would result in comparatorClassName not assigned (to concrete comparator
> classname) due to the following check (line 366):
>
>     if (majorVersion > 1) {
>
> Cheers
>
> On Wed, Jan 16, 2013 at 3:02 PM, lars hofhansl <[EMAIL PROTECTED]> wrote:
>
> > In some of the failed test logs in trunk precommit I see these.
> > Look bad. Is that something to worry about?
> >
> >
> > java.io.IOException: java.io.IOException: java.io.IOException:
> > java.lang.InstantiationException: org.apache.hadoop.io.RawComparator
> >     at
> >
> org.apache.hadoop.hbase.regionserver.HRegion.initializeRegionInternals(HRegion.java:612)
> >     at
> > org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:533)
> >     at
> >
> org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4086)
> >     at
> >
> org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4036)
> >     at
> >
> org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.openRegion(OpenRegionHandler.java:427)
> >     at
> >
> org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.process(OpenRegionHandler.java:130)
> >     at
> > org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:202)
> >     at
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> >     at
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> >     at java.lang.Thread.run(Thread.java:662)
> > Caused by: java.io.IOException: java.io.IOException:
> > java.lang.InstantiationException: org.apache.hadoop.io.RawComparator
> >     at
> >
> org.apache.hadoop.hbase.regionserver.HStore.loadStoreFiles(HStore.java:450)
> >     at
> org.apache.hadoop.hbase.regionserver.HStore.<init>(HStore.java:215)
> >     at
> >
> org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:3060)
> >     at
> > org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:585)
> >     at
> > org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:583)
> >     at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> >     at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> >     at
> > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
> >     at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> >     at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> >     ... 3 more
> > Caused by: java.io.IOException: java.lang.InstantiationException:
> > org.apache.hadoop.io.RawComparator
> >     at
> >
> org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.createComparator(FixedFileTrailer.java:607)
> >     at
> >
> org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.createComparator(FixedFileTrailer.java:615)
> >     at
> >
> org.apache.hadoop.hbase.io.hfile.HFileReaderV2.<init>(HFileReaderV2.java:115)
> >     at
> > org.apache.hadoop.hbase.io.hfile.HFile.pickReaderVersion(HFile.java:564)
> >     at
> >
> org.apache.hadoop.hbase.io.hfile.HFile.createReaderWithEncoding(HFile.java:599)
> >     at
> >
> org.apache.hadoop.hbase.regionserver.StoreFile$Reader.<init>(StoreFile.java:1294)
> >     at
> > org.apache.hadoop.hbase.regionserver.StoreFile.open(StoreFile.java:525)
> >     at
> >
> org.apache.hadoop.hbase.regionserver.StoreFile.createReader(StoreFile.java:628)
> >     at
> org.apache.hadoop.hbase.regionserver.HStore$1.call(HStore.java:426)

Best regards,

   - Andy

Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)
+
Stack 2013-01-16, 23:26
+
Ted Yu 2013-01-16, 23:28
+
lars hofhansl 2013-01-16, 23:47
+
Andrew Purtell 2013-01-17, 00:20
+
Andrew Purtell 2013-01-16, 23:29