Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase >> mail # dev >> unable to run unit test in trunk against hadoop 2.0


+
Ted Yu 2013-04-10, 21:01
+
Jonathan Hsieh 2013-04-10, 21:37
+
Ted Yu 2013-04-10, 21:40
+
Jonathan Hsieh 2013-04-10, 21:49
+
Ted Yu 2013-04-10, 21:52
+
Andrew Purtell 2013-04-11, 18:02
Copy link to this message
-
Re: unable to run unit test in trunk against hadoop 2.0
I think we're back to business.

On Thu, Apr 11, 2013 at 11:02 AM, Andrew Purtell <[EMAIL PROTECTED]>wrote:

> I didn't confirm anything, I made a comment on a JIRA that expresses an
> opinion. HBASE-8165 has been reverted. Is there still an issue here?
>
>
> On Wed, Apr 10, 2013 at 2:52 PM, Ted Yu <[EMAIL PROTECTED]> wrote:
>
> > Andy commented on HBASE-8165, confirming that the test failures were due
> to
> > incompatibilities between protobuf (2.5.0) HBase uses and the version
> (2.4)
> > that hadoop 2.0 uses.
> >
> > On Wed, Apr 10, 2013 at 2:49 PM, Jonathan Hsieh <[EMAIL PROTECTED]>
> wrote:
> >
> > > From this [1] build, it looks like one of these two introduced the
> > problem
> > > -- :
> > >
> > >    1. HBASE-8266-Master cannot start if TableNotFoundException is
> thrown
> > >    while partial table recovery(Ram)
> > > (detail<
> > >
> >
> http://54.241.6.143/job/HBase-TRUNK-Hadoop-2/org.apache.hbase$hbase-server/106/changes#detail0
> > > >
> > >    )
> > >    2. HBASE-8165 Update our protobuf to 2.5 from 2.4.1
> > > (detail<
> > >
> >
> http://54.241.6.143/job/HBase-TRUNK-Hadoop-2/org.apache.hbase$hbase-server/106/changes#detail1
> > > >
> > >    )
> > >
> > >
> > > Spent a minute to look at the errors, it looks like all of them are
> > related
> > > to protobuf -- looks like HBASE-8165 is the trigger.  Have you tried
> > doing
> > > a 'mvn instal' to upated the hbase-protocol module to see if that fixed
> > the
> > > problem?
> > >
> > > [1]
> > >
> > >
> >
> http://54.241.6.143/job/HBase-TRUNK-Hadoop-2/org.apache.hbase$hbase-server/106/#showFailuresLink
> > >
> > > On Wed, Apr 10, 2013 at 2:40 PM, Ted Yu <[EMAIL PROTECTED]> wrote:
> > >
> > > > Jon:
> > > > Looks like your workspace was out of date.
> > > >
> > > > Have you seen this (204 test failures) ?
> > > >
> > > > http://54.241.6.143/job/HBase-TRUNK-Hadoop-2/107/testReport/
> > > >
> > > > On Wed, Apr 10, 2013 at 2:37 PM, Jonathan Hsieh <[EMAIL PROTECTED]>
> > > wrote:
> > > >
> > > > > Hey Ted,
> > > > >
> > > > > I was working on fixing that particular unit test against hadoop2
> > this
> > > > > morning in HBASE-7606 and it seems to work for me (after the patch.
> > > > Before
> > > > > the patch it tends to hang).  Are you running it like this:
> > > > >
> > > > > $ mvn clean test -Dhadoop.profile=2.0 -Dtest=TestJoinedScanners
> > > > > ....
> > > > > -------------------------------------------------------
> > > > >  T E S T S
> > > > > -------------------------------------------------------
> > > > > Running org.apache.hadoop.hbase.regionserver.TestJoinedScanners
> > > > > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:
> > 63.813
> > > > sec
> > > > >
> > > > >
> > > > > Jon.
> > > > >
> > > > >
> > > > > On Wed, Apr 10, 2013 at 2:01 PM, Ted Yu <[EMAIL PROTECTED]>
> wrote:
> > > > >
> > > > > > Hi,
> > > > > > I am getting the following error when trying to run unit test in
> > > trunk
> > > > > > against hadoop 2.0:
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> testJoinedScanners(org.apache.hadoop.hbase.regionserver.TestJoinedScanners)
> > > > > >  Time elapsed: 2.518 sec  <<< ERROR!
> > > > > > java.lang.UnsupportedOperationException: This is supposed to be
> > > > > overridden
> > > > > > by subclasses.
> > > > > >   at
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> com.google.protobuf.GeneratedMessage.getUnknownFields(GeneratedMessage.java:180)
> > > > > >   at
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$GetDatanodeReportRequestProto.getSerializedSize(ClientNamenodeProtocolProtos.java:21566)
> > > > > >   at
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> com.google.protobuf.AbstractMessageLite.toByteString(AbstractMessageLite.java:49)
> > > > > >   at
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.constructRpcRequest(ProtobufRpcEngine.java:149)
> > > > > >   at
> > > > > >
>