Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase, mail # user - Tests fail while building 0.90.3


Copy link to this message
-
Re: Tests fail while building 0.90.3
Vandana Ayyalasomayajula 2011-06-23, 18:07
Sure Ted.
On Jun 23, 2011, at 2:14 AM, Ted Yu wrote:

> I think both the table name and the method name should be changed.
>
> If you can file a JIRA, that would be nice.
>
> Thanks
>
> On Wed, Jun 22, 2011 at 11:44 PM, Vandana Ayyalasomayajula <
> [EMAIL PROTECTED]> wrote:
>
>> Hi Ted,
>>
>> I will send you the corrected patch. Should both the table name and the
>> method name be changed or
>> just the method name?  I had changed the method name and things worked out
>> well.
>>
>> Thanks
>> Vandana
>> On Jun 22, 2011, at 4:59 PM, Ted Yu wrote:
>>
>>> I checked both 0.90 branch and trunk - indeed, testWritesWhileScanning is
>>> used as tablename for testWritesWhileGetting
>>>
>>> Do you mind filing a JIRA ?
>>>
>>> BTW there seems to be some issue with your patch/diff - it seems to show
>>> your change in the other direction. I can help you generate a correct
>> patch.
>>>
>>> Thanks Vandana.
>>>
>>> On Wed, Jun 22, 2011 at 4:06 PM, Vandana Ayyalasomayajula <
>>> [EMAIL PROTECTED]> wrote:
>>>
>>>> Thanks Ted for suggesting to use eclipse and debug the tests. It helped
>> a
>>>> lot.
>>>>
>>>> So the issue is with the "testWritesWhileGetting" unit test in the
>>>> org.apache.hadoop.hbase.regionserver.TestHRegion test.  In the unit
>> test,
>>>> "initHRegion" method is used to initialize a new HRegion.This method
>> tries
>>>> to create a new HRegion, if one does not exist else deletes an
>>>> existing one and creates it again. In my case, the deletion was not
>>>> happening as the log files related to the previously created HRegion
>>>> were still in use and hence the IO exeception.
>>>>
>>>> I looked into a little deeper to find that "initHRegion" method takes
>>>> inputs as table name, calling method name and names of column families.
>>>> In this unit test, both the table name and the calling method name were
>>>> "testWritesWhileScanning". I changed the calling method name to be
>>>> "testWritesWhileGetting" and all my unit tests pass.
>>>>
>>>> So I am suspecting this was a small error in the test, which needs to be
>>>> fixed. Please let me know if this is not the case.
>>>>
>>>> Thanks
>>>> Vandana
>>>>
>>>>
>>>>
>>>> On Jun 19, 2011, at 2:56 PM, Ted Yu wrote:
>>>>
>>>>> If TestHRegion-output.txt doesn't give us much clue, you can debug the
>>>> test
>>>>> in Eclipse, e.g.
>>>>> The following command would generate .project file:
>>>>> mvn eclipse:eclipse
>>>>>
>>>>> On Fri, Jun 17, 2011 at 9:01 AM, Vandana Ayyalasomayajula <
>>>>> [EMAIL PROTECTED]> wrote:
>>>>>
>>>>>> The file is not there on my computer. So is there something I am
>> missing
>>>> to
>>>>>> do before the build process ?
>>>>>>
>>>>>>
>>>>>> On Jun 17, 2011, at 2:11 AM, Ted Yu wrote:
>>>>>>
>>>>>>> I was hoping to see more clue as to why
>>>>>>>
>>>>>>
>>>>
>> /homes/avandana/hbase/hbase-0.90.3/build/hbase/test/TestHRegion/testWritesWhileScanning
>>>>>>> couldn't be deleted.
>>>>>>>
>>>>>>> Did you verify whether the file was on your computer ?
>>>>>>>
>>>>>>> BTW I looked at the output.txt on my laptop. The log about HDFS-826
>> and
>>>>>>> HDFS-200 was there - but the test passed.
>>>>>>> Cheers
>>>>>>> On Fri, Jun 17, 2011 at 1:50 PM, Vandana Ayyalasomayajula <
>>>>>>> [EMAIL PROTECTED]> wrote:
>>>>>>>
>>>>>>>> The contents of
>>>>>> TEST-org.apache.hadoop.hbase.regionserver.TestHRegion.xml
>>>>>>>> is available at:
>>>>>>>> http://pastebin.com/myGhd273
>>>>>>>>
>>>>>>>> The error can be found here. I think that is causing the exception.
>>>>>>>>
>>>>>>>> Thanks
>>>>>>>> Vandana
>>>>>>>> On Jun 16, 2011, at 5:54 PM, Ted Yu wrote:
>>>>>>>>
>>>>>>>>> IOException didn't appear in output.txt
>>>>>>>>> Please give stack trace for the exception.
>>>>>>>>>
>>>>>>>>> I noticed the following in the output:
>>>>>>>>>
>>>>>>>>> 2011-06-16 16:23:19,585 INFO  [main] wal.HLog(396):
>>>>>>>>> getNumCurrentReplicas--HDFS-826 not available;
>>>>>>>>>
>>>>>>>>
>>>>>>
>>>>
>> hdfs_out=org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSOutputSummer@6ec5122f

Vandana Ayyalasomayajula