Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase, mail # dev - Re: Build failed in Jenkins: HBase-TRUNK #3498


+
Ted Yu 2012-10-30, 20:56
+
Ted Yu 2012-12-03, 03:44
+
lars hofhansl 2012-11-14, 02:05
+
lars hofhansl 2012-11-14, 19:55
+
Jimmy Xiang 2012-11-14, 20:12
Copy link to this message
-
Re: Build failed in Jenkins: HBase-0.94 #589
lars hofhansl 2012-11-14, 20:18
Here're the test that failed recently without a fix:
TestSplitLogManager.testUnassignedTimeout x 3
TestSplitLogManager.testMultipleResubmits
TestSplitTransactionOnCluster.testShutdownFixupWhenDaughterHasSplit x 2
TestSplitTransactionOnCluster.testMasterRestartWhenSplittingIsPartial
TestSplitTransactionOnCluster.testShouldThrowIOExceptionIfStoreFileSizeIsEmptyAndSHouldSuccessfullyExecuteRollback
TestCatalogTrackerOnCluster.testBadOriginalRootLocation
TestDistributedLogSplitting.testDelayedDeleteOnFailure
TestScannerTimeout.test3686a
TestReplication.testVerifyRepJob
TestReplication.queueFailover
TestFromClientSideWithCoprocessor.testPoolBehavior
TestColumnSeeking.testDuplicateVersions

Based on that at least TestSplitLogManager.testUnassignedTimeout should get the axe (or be investigated)

-- Lars

----- Original Message -----
From: Jimmy Xiang <[EMAIL PROTECTED]>
To: [EMAIL PROTECTED]; lars hofhansl <[EMAIL PROTECTED]>
Cc:
Sent: Wednesday, November 14, 2012 12:12 PM
Subject: Re: Build failed in Jenkins: HBase-0.94 #589

I agree. +1

We can keep a list of flaky tests so that we can fix them later on.

Thanks,
Jimmy

On Wed, Nov 14, 2012 at 11:55 AM, lars hofhansl <[EMAIL PROTECTED]> wrote:
> Sigh.
>
> It seems we're back at having a successful build being the exception rather than the rule.
> In this case it was some(?) timeout (all tests ran and passed), but many previous runs had at least one test failing.
>
> Flaky tests are useless. They do not add confidence to a run, and worse they add noise, which requires us to manually filter the good from the bad runs but looking at the results.
>
> There was talk about separating the flaky tests from the good ones.
> Short term I propose to disable or remove every test that failed more than once in the last 10 runs.
>
>
> This is getting quite frustrating.
>
> -- Lars
>
>
> ----- Original Message -----
> From: Apache Jenkins Server <[EMAIL PROTECTED]>
> To: [EMAIL PROTECTED]
> Cc:
> Sent: Wednesday, November 14, 2012 11:13 AM
> Subject: Build failed in Jenkins: HBase-0.94 #589
>
> See <https://builds.apache.org/job/HBase-0.94/589/>
>
> ------------------------------------------
> [...truncated 581 lines...]
> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.706 sec
> Running org.apache.hadoop.hbase.regionserver.TestAtomicOperation
> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.647 sec
> Running org.apache.hadoop.hbase.regionserver.TestSplitTransactionOnCluster
> Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 117.495 sec
> Running org.apache.hadoop.hbase.regionserver.TestRegionServerMetrics
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 114.374 sec
> Running org.apache.hadoop.hbase.regionserver.metrics.TestSchemaMetrics
> Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.448 sec
> Running org.apache.hadoop.hbase.regionserver.TestHRegionOnCluster
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 43.172 sec
> Running org.apache.hadoop.hbase.regionserver.TestBlocksRead
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.987 sec
> Running org.apache.hadoop.hbase.regionserver.TestStoreFileBlockCacheSummary
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 34.313 sec
> Running org.apache.hadoop.hbase.regionserver.wal.TestLogRollingNoCluster
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.529 sec
> Running org.apache.hadoop.hbase.regionserver.TestHRegion
> Tests run: 69, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 58.763 sec
> Running org.apache.hadoop.hbase.regionserver.TestFSErrorsExposed
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 43.326 sec
> Running org.apache.hadoop.hbase.regionserver.TestCompactionWithCoprocessor
> Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.335 sec
> Running org.apache.hadoop.hbase.regionserver.wal.TestWALReplay
> Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 62.393 sec
+
Ted Yu 2012-11-14, 20:30
+
lars hofhansl 2012-11-14, 20:40
+
lars hofhansl 2012-11-17, 01:26
+
ramkrishna vasudevan 2012-11-17, 05:04
+
lars hofhansl 2012-12-31, 03:22
+
Stack 2012-12-19, 16:19
+
lars hofhansl 2012-12-28, 07:53
+
lars hofhansl 2012-12-28, 08:27
+
lars hofhansl 2012-12-29, 07:31
+
lars hofhansl 2012-12-29, 07:42
+
Stack 2012-12-26, 18:58
+
lars hofhansl 2012-12-26, 19:14
+
Stack 2012-12-26, 19:27
+
lars hofhansl 2012-12-26, 19:57
+
Ted Yu 2013-01-17, 15:17
+
Jean-Marc Spaggiari 2013-01-17, 15:22
+
lars hofhansl 2013-02-02, 05:53
+
Matteo Bertozzi 2013-03-04, 13:37
+
Stack 2013-03-04, 18:03
+
lars hofhansl 2013-03-05, 02:15
+
Stack 2013-03-07, 07:37
+
lars hofhansl 2013-03-07, 19:07
+
Stack 2013-03-08, 17:23
+
ramkrishna vasudevan 2013-03-08, 17:26
+
Matteo Bertozzi 2013-03-08, 17:40
+
Ted Yu 2013-03-08, 17:50
+
Stack 2013-03-08, 18:13
+
Stack 2013-03-09, 04:11
+
Stack 2013-03-09, 16:38
+
Ted Yu 2013-03-12, 04:36
+
Andrew Purtell 2013-03-12, 04:42
+
Ted Yu 2013-03-12, 04:50
+
ramkrishna vasudevan 2013-03-13, 17:51
+
Ted Yu 2013-03-13, 18:30
+
Vikas Jadhav 2013-03-12, 05:41
+
lars hofhansl 2013-03-12, 05:53
+
Ted Yu 2013-03-19, 14:29
+
Andrew Purtell 2013-03-19, 15:39
+
Ted Yu 2013-03-19, 16:20
+
Ted Yu 2013-03-19, 16:24
+
Andrew Purtell 2013-03-19, 16:49
+
ramkrishna vasudevan 2013-03-19, 16:54
+
Ted Yu 2013-03-19, 16:59
+
lars hofhansl 2013-03-19, 18:17
+
Ted Yu 2013-03-19, 21:12
+
lars hofhansl 2013-03-19, 22:50
+
Ted Yu 2013-03-19, 22:53
+
lars hofhansl 2013-03-19, 23:45
+
Stack 2013-03-23, 21:43
+
Sergey Shelukhin 2013-04-10, 00:01
+
Ted Yu 2013-04-10, 00:08
+
Stack 2013-04-10, 06:35
+
Nicolas Liochon 2013-04-10, 07:16
+
Stack 2013-04-10, 16:38
+
Sergey Shelukhin 2013-04-10, 18:43
+
Nicolas Liochon 2013-04-10, 19:04
+
Sergey Shelukhin 2013-04-10, 19:45
+
Ted Yu 2013-04-10, 19:52
+
Stack 2013-04-10, 20:03
+
Jean-Daniel Cryans 2013-04-23, 20:21
+
Stack 2013-04-24, 15:40
+
Andrew Purtell 2013-04-25, 01:02
+
Jonathan Hsieh 2013-05-02, 14:03
+
Jonathan Hsieh 2013-05-02, 14:00
+
Jonathan Hsieh 2013-05-02, 13:52
+
Jonathan Hsieh 2013-05-02, 14:20
+
Jonathan Hsieh 2013-05-02, 14:38
+
Jonathan Hsieh 2013-05-04, 18:20
+
Jonathan Hsieh 2013-05-04, 18:23
+
Jonathan Hsieh 2013-05-07, 13:17
+
Jonathan Hsieh 2013-05-07, 13:16
+
Jonathan Hsieh 2013-05-07, 13:15
+
Jonathan Hsieh 2013-05-07, 13:14
+
Jonathan Hsieh 2013-05-07, 13:19
+
Jonathan Hsieh 2013-05-06, 21:18
+
Jonathan Hsieh 2013-05-06, 21:17
+
Jonathan Hsieh 2013-05-06, 21:16
+
Jonathan Hsieh 2013-05-06, 21:12
+
Jonathan Hsieh 2013-05-06, 21:20
+
Sergey Shelukhin 2013-05-06, 22:01
+
Jonathan Hsieh 2013-05-07, 13:39
+
Jonathan Hsieh 2013-05-06, 21:19
+
Jonathan Hsieh 2013-05-08, 17:00
+
Jonathan Hsieh 2013-05-08, 16:59
+
Jonathan Hsieh 2013-05-08, 16:55
+
Jonathan Hsieh 2013-05-08, 16:57
+
Jonathan Hsieh 2013-05-08, 16:54
+
Stack 2013-05-09, 04:02
+
Stack 2013-05-09, 04:17
+
Stack 2013-05-09, 04:16
+
Stack 2013-05-09, 04:08
+
Andrew Purtell 2013-05-09, 07:35
+
Andrew Purtell 2013-05-09, 08:23
+
Ted Yu 2013-05-09, 09:07
+
Andrew Purtell 2013-05-09, 09:10
+
Ted Yu 2013-05-09, 09:18
+
Andrew Purtell 2013-05-09, 09:20
+
Andrew Purtell 2013-05-10, 10:48
+
Jonathan Hsieh 2013-05-09, 12:52
+
Jonathan Hsieh 2013-05-09, 12:51
+
Jonathan Hsieh 2013-05-09, 12:50
+
Jonathan Hsieh 2013-05-09, 12:48
+
Jonathan Hsieh 2013-05-09, 12:45
+
Jonathan Hsieh 2013-05-09, 12:44
+
Jonathan Hsieh 2013-05-09, 12:43
+
Stack 2013-05-15, 19:38
+
Stack 2013-05-15, 18:19
+
Ted Yu 2013-05-15, 18:26
+
Stack 2013-05-15, 18:32
+
Ted Yu 2013-05-15, 18:43
+
Jonathan Hsieh 2013-05-15, 19:23
+
Stack 2013-05-15, 18:06
+
Stack 2013-05-15, 08:31
+
Stack 2013-05-15, 23:41
+
Elliott Clark 2013-05-16, 00:01
+
Stack 2013-05-16, 21:42
+
Ted Yu 2013-05-17, 23:07
+
Stack 2013-05-18, 03:27
+
Stack 2013-05-24, 05:17
+
lars hofhansl 2013-05-25, 07:22
+
Ted Yu 2013-05-25, 15:52
+
lars hofhansl 2013-05-29, 00:54
+
Andrew Purtell 2013-05-29, 15:05
+
Andrew Purtell 2013-05-29, 15:12
+
lars hofhansl 2013-05-29, 17:39
+
Andrew Purtell 2013-06-11, 02:35