Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> Tests fail while building 0.90.3


Copy link to this message
-
Re: Tests fail while building 0.90.3
Sure Ted.
On Jun 23, 2011, at 2:14 AM, Ted Yu wrote:

> I think both the table name and the method name should be changed.
>
> If you can file a JIRA, that would be nice.
>
> Thanks
>
> On Wed, Jun 22, 2011 at 11:44 PM, Vandana Ayyalasomayajula <
> [EMAIL PROTECTED]> wrote:
>
>> Hi Ted,
>>
>> I will send you the corrected patch. Should both the table name and the
>> method name be changed or
>> just the method name?  I had changed the method name and things worked out
>> well.
>>
>> Thanks
>> Vandana
>> On Jun 22, 2011, at 4:59 PM, Ted Yu wrote:
>>
>>> I checked both 0.90 branch and trunk - indeed, testWritesWhileScanning is
>>> used as tablename for testWritesWhileGetting
>>>
>>> Do you mind filing a JIRA ?
>>>
>>> BTW there seems to be some issue with your patch/diff - it seems to show
>>> your change in the other direction. I can help you generate a correct
>> patch.
>>>
>>> Thanks Vandana.
>>>
>>> On Wed, Jun 22, 2011 at 4:06 PM, Vandana Ayyalasomayajula <
>>> [EMAIL PROTECTED]> wrote:
>>>
>>>> Thanks Ted for suggesting to use eclipse and debug the tests. It helped
>> a
>>>> lot.
>>>>
>>>> So the issue is with the "testWritesWhileGetting" unit test in the
>>>> org.apache.hadoop.hbase.regionserver.TestHRegion test.  In the unit
>> test,
>>>> "initHRegion" method is used to initialize a new HRegion.This method
>> tries
>>>> to create a new HRegion, if one does not exist else deletes an
>>>> existing one and creates it again. In my case, the deletion was not
>>>> happening as the log files related to the previously created HRegion
>>>> were still in use and hence the IO exeception.
>>>>
>>>> I looked into a little deeper to find that "initHRegion" method takes
>>>> inputs as table name, calling method name and names of column families.
>>>> In this unit test, both the table name and the calling method name were
>>>> "testWritesWhileScanning". I changed the calling method name to be
>>>> "testWritesWhileGetting" and all my unit tests pass.
>>>>
>>>> So I am suspecting this was a small error in the test, which needs to be
>>>> fixed. Please let me know if this is not the case.
>>>>
>>>> Thanks
>>>> Vandana
>>>>
>>>>
>>>>
>>>> On Jun 19, 2011, at 2:56 PM, Ted Yu wrote:
>>>>
>>>>> If TestHRegion-output.txt doesn't give us much clue, you can debug the
>>>> test
>>>>> in Eclipse, e.g.
>>>>> The following command would generate .project file:
>>>>> mvn eclipse:eclipse
>>>>>
>>>>> On Fri, Jun 17, 2011 at 9:01 AM, Vandana Ayyalasomayajula <
>>>>> [EMAIL PROTECTED]> wrote:
>>>>>
>>>>>> The file is not there on my computer. So is there something I am
>> missing
>>>> to
>>>>>> do before the build process ?
>>>>>>
>>>>>>
>>>>>> On Jun 17, 2011, at 2:11 AM, Ted Yu wrote:
>>>>>>
>>>>>>> I was hoping to see more clue as to why
>>>>>>>
>>>>>>
>>>>
>> /homes/avandana/hbase/hbase-0.90.3/build/hbase/test/TestHRegion/testWritesWhileScanning
>>>>>>> couldn't be deleted.
>>>>>>>
>>>>>>> Did you verify whether the file was on your computer ?
>>>>>>>
>>>>>>> BTW I looked at the output.txt on my laptop. The log about HDFS-826
>> and
>>>>>>> HDFS-200 was there - but the test passed.
>>>>>>> Cheers
>>>>>>> On Fri, Jun 17, 2011 at 1:50 PM, Vandana Ayyalasomayajula <
>>>>>>> [EMAIL PROTECTED]> wrote:
>>>>>>>
>>>>>>>> The contents of
>>>>>> TEST-org.apache.hadoop.hbase.regionserver.TestHRegion.xml
>>>>>>>> is available at:
>>>>>>>> http://pastebin.com/myGhd273
>>>>>>>>
>>>>>>>> The error can be found here. I think that is causing the exception.
>>>>>>>>
>>>>>>>> Thanks
>>>>>>>> Vandana
>>>>>>>> On Jun 16, 2011, at 5:54 PM, Ted Yu wrote:
>>>>>>>>
>>>>>>>>> IOException didn't appear in output.txt
>>>>>>>>> Please give stack trace for the exception.
>>>>>>>>>
>>>>>>>>> I noticed the following in the output:
>>>>>>>>>
>>>>>>>>> 2011-06-16 16:23:19,585 INFO  [main] wal.HLog(396):
>>>>>>>>> getNumCurrentReplicas--HDFS-826 not available;
>>>>>>>>>
>>>>>>>>
>>>>>>
>>>>
>> hdfs_out=org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSOutputSummer@6ec5122f

Vandana Ayyalasomayajula
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB