Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase, mail # user - Tests fail while building 0.90.3


Copy link to this message
-
Re: Tests fail while building 0.90.3
Vandana Ayyalasomayajula 2011-06-22, 23:37

On Jun 22, 2011, at 4:34 PM, Vandana Ayyalasomayajula wrote:

Hi Ted,

I have attached the patch to this mail.

Thanks

On Jun 22, 2011, at 4:14 PM, Ted Yu wrote:

> Do you mind sending out a patch ?
>
> Thanks Vandana.
>
> On Wed, Jun 22, 2011 at 4:06 PM, Vandana Ayyalasomayajula <
> [EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
>
>> Thanks Ted for suggesting to use eclipse and debug the tests. It helped a
>> lot.
>>
>> So the issue is with the "testWritesWhileGetting" unit test in the
>> org.apache.hadoop.hbase.regionserver.TestHRegion test.  In the unit test,
>> "initHRegion" method is used to initialize a new HRegion.This method tries
>> to create a new HRegion, if one does not exist else deletes an
>> existing one and creates it again. In my case, the deletion was not
>> happening as the log files related to the previously created HRegion
>> were still in use and hence the IO exeception.
>>
>> I looked into a little deeper to find that "initHRegion" method takes
>> inputs as table name, calling method name and names of column families.
>> In this unit test, both the table name and the calling method name were
>> "testWritesWhileScanning". I changed the calling method name to be
>> "testWritesWhileGetting" and all my unit tests pass.
>>
>> So I am suspecting this was a small error in the test, which needs to be
>> fixed. Please let me know if this is not the case.
>>
>> Thanks
>> Vandana
>>
>>
>>
>> On Jun 19, 2011, at 2:56 PM, Ted Yu wrote:
>>
>>> If TestHRegion-output.txt doesn't give us much clue, you can debug the
>> test
>>> in Eclipse, e.g.
>>> The following command would generate .project file:
>>> mvn eclipse:eclipse
>>>
>>> On Fri, Jun 17, 2011 at 9:01 AM, Vandana Ayyalasomayajula <
>>> [EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
>>>
>>>> The file is not there on my computer. So is there something I am missing
>> to
>>>> do before the build process ?
>>>>
>>>>
>>>> On Jun 17, 2011, at 2:11 AM, Ted Yu wrote:
>>>>
>>>>> I was hoping to see more clue as to why
>>>>>
>>>>
>> /homes/avandana/hbase/hbase-0.90.3/build/hbase/test/TestHRegion/testWritesWhileScanning
>>>>> couldn't be deleted.
>>>>>
>>>>> Did you verify whether the file was on your computer ?
>>>>>
>>>>> BTW I looked at the output.txt on my laptop. The log about HDFS-826 and
>>>>> HDFS-200 was there - but the test passed.
>>>>> Cheers
>>>>> On Fri, Jun 17, 2011 at 1:50 PM, Vandana Ayyalasomayajula <
>>>>> [EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
>>>>>
>>>>>> The contents of
>>>> TEST-org.apache.hadoop.hbase.regionserver.TestHRegion.xml
>>>>>> is available at:
>>>>>> http://pastebin.com/myGhd273
>>>>>>
>>>>>> The error can be found here. I think that is causing the exception.
>>>>>>
>>>>>> Thanks
>>>>>> Vandana
>>>>>> On Jun 16, 2011, at 5:54 PM, Ted Yu wrote:
>>>>>>
>>>>>>> IOException didn't appear in output.txt
>>>>>>> Please give stack trace for the exception.
>>>>>>>
>>>>>>> I noticed the following in the output:
>>>>>>>
>>>>>>> 2011-06-16 16:23:19,585 INFO  [main] wal.HLog(396):
>>>>>>> getNumCurrentReplicas--HDFS-826 not available;
>>>>>>>
>>>>>>
>>>>
>> hdfs_out=org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSOutputSummer@6ec5122f
>>>>>> ,
>>>>>>>
>>>>>>
>>>>
>> exception=org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSOutputSummer.getNumCurrentReplicas()
>>>>>>>
>>>>>>> On Fri, Jun 17, 2011 at 7:30 AM, Vandana Ayyalasomayajula <
>>>>>>> [EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
>>>>>>>
>>>>>>>> Hi,
>>>>>>>>
>>>>>>>> I am running the build on rhel 5 machine. I ran the following
>> command:
>>>>>>>>
>>>>>>>> mvn clean test -Dtest=TestHRegion
>>>>>>>>
>>>>>>>> and the contents of TestHRegion-output.txt are in:
>>>>>>>>
>>>>>>>> http://pastebin.com/0WZkapGD
>>>>>>>>
>>>>>>>> Thanks
>>>>>>>> Vandana
>>>>>>>>
>>>>>>>> On Jun 16, 2011, at 4:03 PM, Stack wrote:
>>>>>>>>
>>>>>>>>> What Ted said and what happens if you run it standalone?
>>>>>>>>>
>>>>>>>>> mvn clean test -Dtest=TestHRegion

Vandana Ayyalasomayajula
Vandana Ayyalasomayajula