Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # dev >> Re: Build failed in Jenkins: HBase-TRUNK #3498


Copy link to this message
-
Re: Build failed in Jenkins: HBase-0.94 #589
I agree. +1

We can keep a list of flaky tests so that we can fix them later on.

Thanks,
Jimmy

On Wed, Nov 14, 2012 at 11:55 AM, lars hofhansl <[EMAIL PROTECTED]> wrote:
> Sigh.
>
> It seems we're back at having a successful build being the exception rather than the rule.
> In this case it was some(?) timeout (all tests ran and passed), but many previous runs had at least one test failing.
>
> Flaky tests are useless. They do not add confidence to a run, and worse they add noise, which requires us to manually filter the good from the bad runs but looking at the results.
>
> There was talk about separating the flaky tests from the good ones.
> Short term I propose to disable or remove every test that failed more than once in the last 10 runs.
>
>
> This is getting quite frustrating.
>
> -- Lars
>
>
> ----- Original Message -----
> From: Apache Jenkins Server <[EMAIL PROTECTED]>
> To: [EMAIL PROTECTED]
> Cc:
> Sent: Wednesday, November 14, 2012 11:13 AM
> Subject: Build failed in Jenkins: HBase-0.94 #589
>
> See <https://builds.apache.org/job/HBase-0.94/589/>
>
> ------------------------------------------
> [...truncated 581 lines...]
> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.706 sec
> Running org.apache.hadoop.hbase.regionserver.TestAtomicOperation
> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.647 sec
> Running org.apache.hadoop.hbase.regionserver.TestSplitTransactionOnCluster
> Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 117.495 sec
> Running org.apache.hadoop.hbase.regionserver.TestRegionServerMetrics
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 114.374 sec
> Running org.apache.hadoop.hbase.regionserver.metrics.TestSchemaMetrics
> Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.448 sec
> Running org.apache.hadoop.hbase.regionserver.TestHRegionOnCluster
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 43.172 sec
> Running org.apache.hadoop.hbase.regionserver.TestBlocksRead
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.987 sec
> Running org.apache.hadoop.hbase.regionserver.TestStoreFileBlockCacheSummary
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 34.313 sec
> Running org.apache.hadoop.hbase.regionserver.wal.TestLogRollingNoCluster
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.529 sec
> Running org.apache.hadoop.hbase.regionserver.TestHRegion
> Tests run: 69, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 58.763 sec
> Running org.apache.hadoop.hbase.regionserver.TestFSErrorsExposed
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 43.326 sec
> Running org.apache.hadoop.hbase.regionserver.TestCompactionWithCoprocessor
> Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.335 sec
> Running org.apache.hadoop.hbase.regionserver.wal.TestWALReplay
> Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 62.393 sec
> Running org.apache.hadoop.hbase.regionserver.wal.TestWALReplayCompressed
> Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 63.048 sec
> Running org.apache.hadoop.hbase.regionserver.wal.TestHLog
> Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 77.468 sec
> Running org.apache.hadoop.hbase.regionserver.wal.TestHLogBench
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.248 sec
> Running org.apache.hadoop.hbase.regionserver.handler.TestCloseRegionHandler
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.552 sec
> Running org.apache.hadoop.hbase.regionserver.handler.TestOpenRegionHandler
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.28 sec
> Running org.apache.hadoop.hbase.regionserver.wal.TestLogRollAbort
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 169.356 sec
> Running org.apache.hadoop.hbase.filter.TestColumnRangeFilter
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 24.342 sec
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB