Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase, mail # dev - Re: Build failed in Jenkins: HBase-TRUNK #3498


Copy link to this message
-
Re: Build failed in Jenkins: HBase-0.94 #589
Jimmy Xiang 2012-11-14, 20:12
I agree. +1

We can keep a list of flaky tests so that we can fix them later on.

Thanks,
Jimmy

On Wed, Nov 14, 2012 at 11:55 AM, lars hofhansl <[EMAIL PROTECTED]> wrote:
> Sigh.
>
> It seems we're back at having a successful build being the exception rather than the rule.
> In this case it was some(?) timeout (all tests ran and passed), but many previous runs had at least one test failing.
>
> Flaky tests are useless. They do not add confidence to a run, and worse they add noise, which requires us to manually filter the good from the bad runs but looking at the results.
>
> There was talk about separating the flaky tests from the good ones.
> Short term I propose to disable or remove every test that failed more than once in the last 10 runs.
>
>
> This is getting quite frustrating.
>
> -- Lars
>
>
> ----- Original Message -----
> From: Apache Jenkins Server <[EMAIL PROTECTED]>
> To: [EMAIL PROTECTED]
> Cc:
> Sent: Wednesday, November 14, 2012 11:13 AM
> Subject: Build failed in Jenkins: HBase-0.94 #589
>
> See <https://builds.apache.org/job/HBase-0.94/589/>
>
> ------------------------------------------
> [...truncated 581 lines...]
> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.706 sec
> Running org.apache.hadoop.hbase.regionserver.TestAtomicOperation
> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.647 sec
> Running org.apache.hadoop.hbase.regionserver.TestSplitTransactionOnCluster
> Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 117.495 sec
> Running org.apache.hadoop.hbase.regionserver.TestRegionServerMetrics
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 114.374 sec
> Running org.apache.hadoop.hbase.regionserver.metrics.TestSchemaMetrics
> Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.448 sec
> Running org.apache.hadoop.hbase.regionserver.TestHRegionOnCluster
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 43.172 sec
> Running org.apache.hadoop.hbase.regionserver.TestBlocksRead
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.987 sec
> Running org.apache.hadoop.hbase.regionserver.TestStoreFileBlockCacheSummary
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 34.313 sec
> Running org.apache.hadoop.hbase.regionserver.wal.TestLogRollingNoCluster
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.529 sec
> Running org.apache.hadoop.hbase.regionserver.TestHRegion
> Tests run: 69, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 58.763 sec
> Running org.apache.hadoop.hbase.regionserver.TestFSErrorsExposed
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 43.326 sec
> Running org.apache.hadoop.hbase.regionserver.TestCompactionWithCoprocessor
> Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.335 sec
> Running org.apache.hadoop.hbase.regionserver.wal.TestWALReplay
> Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 62.393 sec
> Running org.apache.hadoop.hbase.regionserver.wal.TestWALReplayCompressed
> Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 63.048 sec
> Running org.apache.hadoop.hbase.regionserver.wal.TestHLog
> Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 77.468 sec
> Running org.apache.hadoop.hbase.regionserver.wal.TestHLogBench
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.248 sec
> Running org.apache.hadoop.hbase.regionserver.handler.TestCloseRegionHandler
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.552 sec
> Running org.apache.hadoop.hbase.regionserver.handler.TestOpenRegionHandler
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.28 sec
> Running org.apache.hadoop.hbase.regionserver.wal.TestLogRollAbort
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 169.356 sec
> Running org.apache.hadoop.hbase.filter.TestColumnRangeFilter
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 24.342 sec