Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS >> mail # dev >> Intermittent test errors in Hadoop-hdfs project


Copy link to this message
-
Intermittent test errors in Hadoop-hdfs project
Hi all,

I'm running Junit tests suite for Hadoop-hdfs project, however none of 3 run attempts could complete successfully.
There were random test failing due to some error and one consistent failure.

I believe one consistently broken test is due to following change, since corresponding "editsStored" binary file is not checked in with modified "editsStored.xml" file in this particular revision.
###############################
Revision: 1552841
Author: cmccabe
Date: Saturday, December 21, 2013 4:57:20 AM
Message:
HDFS-5636. Enforce a max TTL per cache pool (awang via cmccabe)
----
.
.
Modified : /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/resources/editsStored.xml
.
###############################

'Tests in error' passed successfully when ran separately. Test results snippet for all 3 runs is attached at the end of this mail.
I would like to know if others also have noted similar observation or there's something wrong with my setup.
If it's a common behaviour how does apache CI handles such scenarios while testing a patch?

Thanks,
Abhijeet.

______________________Test results snippets ________________________

Run1
Failed tests:
  TestOfflineEditsViewer.testStored:193 Reference XML edits and parsed to XML should be same

Tests in error:
  TestHDFSFileSystemContract.setUp:39 » IO Failed to save in any storage directo...
  TestDatanodeReport.testDatanodeReport:48 » InconsistentFSState Directory /home...
#######################
Run2
Failed tests:
  TestOfflineEditsViewer.testStored:193 Reference XML edits and parsed to XML should be same

Tests in error:
  TestLeaseRecovery.testBlockSynchronization:80 » IO NameNode is not formatted.
  TestDataNodeVolumeFailureToleration.setUp:71 » IO Timed out waiting for Mini H...
  TestDataNodeVolumeFailureToleration.tearDown:83 NullPointer
#######################
Run 3
Failed tests:
  TestOfflineEditsViewer.testStored:193 Reference XML edits and parsed to XML should be same

Tests in error:
  TestAppendDifferentChecksum.setupCluster:52 » IO Cannot lock storage /home/abh...
  TestFileAppend3.testTC12 » Remote No lease on /TC12/foo: File is not open for ...
  TestHDFSFileSystemContract.setUp:39 » InconsistentFSState Directory /home/abhi...
######################
DISCLAIMER
=========This e-mail may contain privileged and confidential information which is the property of Persistent Systems Ltd. It is intended only for the use of the individual or entity to which it is addressed. If you are not the intended recipient, you are not authorized to read, retain, copy, print, distribute or use this message. If you have received this communication in error, please notify the sender and delete all copies of this message. Persistent Systems Ltd. does not accept any liability for virus infected mails.