Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase, mail # dev - Re: Build failed in Jenkins: HBase-TRUNK #3498


Copy link to this message
-
Re: Build failed in Jenkins: HBase-0.94 #589
lars hofhansl 2012-11-14, 19:55
Sigh.

It seems we're back at having a successful build being the exception rather than the rule.
In this case it was some(?) timeout (all tests ran and passed), but many previous runs had at least one test failing.

Flaky tests are useless. They do not add confidence to a run, and worse they add noise, which requires us to manually filter the good from the bad runs but looking at the results.

There was talk about separating the flaky tests from the good ones.
Short term I propose to disable or remove every test that failed more than once in the last 10 runs.
This is getting quite frustrating.

-- Lars
----- Original Message -----
From: Apache Jenkins Server <[EMAIL PROTECTED]>
To: [EMAIL PROTECTED]
Cc:
Sent: Wednesday, November 14, 2012 11:13 AM
Subject: Build failed in Jenkins: HBase-0.94 #589

See <https://builds.apache.org/job/HBase-0.94/589/>

------------------------------------------
[...truncated 581 lines...]
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.706 sec
Running org.apache.hadoop.hbase.regionserver.TestAtomicOperation
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.647 sec
Running org.apache.hadoop.hbase.regionserver.TestSplitTransactionOnCluster
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 117.495 sec
Running org.apache.hadoop.hbase.regionserver.TestRegionServerMetrics
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 114.374 sec
Running org.apache.hadoop.hbase.regionserver.metrics.TestSchemaMetrics
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.448 sec
Running org.apache.hadoop.hbase.regionserver.TestHRegionOnCluster
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 43.172 sec
Running org.apache.hadoop.hbase.regionserver.TestBlocksRead
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.987 sec
Running org.apache.hadoop.hbase.regionserver.TestStoreFileBlockCacheSummary
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 34.313 sec
Running org.apache.hadoop.hbase.regionserver.wal.TestLogRollingNoCluster
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.529 sec
Running org.apache.hadoop.hbase.regionserver.TestHRegion
Tests run: 69, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 58.763 sec
Running org.apache.hadoop.hbase.regionserver.TestFSErrorsExposed
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 43.326 sec
Running org.apache.hadoop.hbase.regionserver.TestCompactionWithCoprocessor
Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.335 sec
Running org.apache.hadoop.hbase.regionserver.wal.TestWALReplay
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 62.393 sec
Running org.apache.hadoop.hbase.regionserver.wal.TestWALReplayCompressed
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 63.048 sec
Running org.apache.hadoop.hbase.regionserver.wal.TestHLog
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 77.468 sec
Running org.apache.hadoop.hbase.regionserver.wal.TestHLogBench
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.248 sec
Running org.apache.hadoop.hbase.regionserver.handler.TestCloseRegionHandler
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.552 sec
Running org.apache.hadoop.hbase.regionserver.handler.TestOpenRegionHandler
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.28 sec
Running org.apache.hadoop.hbase.regionserver.wal.TestLogRollAbort
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 169.356 sec
Running org.apache.hadoop.hbase.filter.TestColumnRangeFilter
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 24.342 sec
Running org.apache.hadoop.hbase.regionserver.TestHRegionServerBulkLoad
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 51.361 sec
Running org.apache.hadoop.hbase.coprocessor.TestAggregateProtocol
Tests run: 45, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.273 sec
Running org.apache.hadoop.hbase.coprocessor.TestClassLoading
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 49.9 sec
Running org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithRemove
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.775 sec
Running org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.899 sec
Running org.apache.hadoop.hbase.coprocessor.TestMasterObserver
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 41.647 sec
Running org.apache.hadoop.hbase.coprocessor.TestCoprocessorEndpoint
Tests run: 3, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 33.635 sec
Running org.apache.hadoop.hbase.coprocessor.TestWALObserver
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.742 sec
Running org.apache.hadoop.hbase.coprocessor.TestMasterCoprocessorExceptionWithAbort
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 29.368 sec
Running org.apache.hadoop.hbase.regionserver.wal.TestLogRolling
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 211.997 sec
Running org.apache.hadoop.hbase.coprocessor.example.TestZooKeeperScanPolicyObserver
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.064 sec
Running org.apache.hadoop.hbase.coprocessor.TestMasterCoprocessorExceptionWithRemove
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.845 sec
Running org.apache.hadoop.hbase.regionserver.wal.TestHLogSplit
Tests run: 30, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 282.678 sec
Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverBypass
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.9 sec
Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverInterface
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 46.997 sec
Running org.apache.hadoop.hbase.coprocessor.exam