Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase >> mail # dev >> Re: Build failed in Jenkins: HBase-TRUNK #3498


+
Ted Yu 2012-10-30, 20:56
+
Ted Yu 2012-12-03, 03:44
+
lars hofhansl 2012-11-14, 02:05
+
lars hofhansl 2012-11-14, 19:55
+
Jimmy Xiang 2012-11-14, 20:12
+
lars hofhansl 2012-11-14, 20:18
+
Ted Yu 2012-11-14, 20:30
+
lars hofhansl 2012-11-14, 20:40
Copy link to this message
-
Re: Build failed in Jenkins: HBase-0.94 #589
I "fixed" the top three failing tests (mostly just race conditions with bad timeouts). "Fixed" is in quotes, because just looked at the point where the tests failed and made a better guess about how long to wait. Waiting some fixed amount of time is almost always bad in tests (unless it is a long wait as a safety guard to ensure the test will eventually end), but that was the fastest avenue to get them to pass.
Will also look at the other tests. I think we should get to 50% pass rate of the jenkins build soon, and then to at least 80% pass rate.
This might mean disabling some of the bad tests.
-- Lars

________________________________
 From: lars hofhansl <[EMAIL PROTECTED]>
To: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]>
Sent: Wednesday, November 14, 2012 12:40 PM
Subject: Re: Build failed in Jenkins: HBase-0.94 #589
 
Agreed. Looking at TestSplitLogManager.testUnassignedTimeout.
It has some pretty tight timeouts (500ms), which is likely to be a problem on slow (or overloaded) build machines.
I'm doubling the timeouts.
Anyway, the current run just got past these too tests, let's hope there're no other failures.
Then we can tackle these tests in 0.94.4 and 0.96.

-- Lars
----- Original Message -----
From: Ted Yu <[EMAIL PROTECTED]>
To: [EMAIL PROTECTED]; lars hofhansl <[EMAIL PROTECTED]>
Cc:
Sent: Wednesday, November 14, 2012 12:30 PM
Subject: Re: Build failed in Jenkins: HBase-0.94 #589

I noticed the test failures in TestSplitTransactionOnCluster

0.94.3 has fix for region splitting issue. I think we should pay a little
attention fixing TestSplitTransactionOnCluster so that it passes more often.

Cheers

On Wed, Nov 14, 2012 at 12:18 PM, lars hofhansl <[EMAIL PROTECTED]> wrote:

> Here're the test that failed recently without a fix:
>
>
> TestSplitLogManager.testUnassignedTimeout x 3
> TestSplitLogManager.testMultipleResubmits
> TestSplitTransactionOnCluster.testShutdownFixupWhenDaughterHasSplit x 2
> TestSplitTransactionOnCluster.testMasterRestartWhenSplittingIsPartial
>
> TestSplitTransactionOnCluster.testShouldThrowIOExceptionIfStoreFileSizeIsEmptyAndSHouldSuccessfullyExecuteRollback
> TestCatalogTrackerOnCluster.testBadOriginalRootLocation
> TestDistributedLogSplitting.testDelayedDeleteOnFailure
> TestScannerTimeout.test3686a
> TestReplication.testVerifyRepJob
> TestReplication.queueFailover
> TestFromClientSideWithCoprocessor.testPoolBehavior
> TestColumnSeeking.testDuplicateVersions
>
>
>
> Based on that at least TestSplitLogManager.testUnassignedTimeout should
> get the axe (or be investigated)
>
> -- Lars
>
> ----- Original Message -----
> From: Jimmy Xiang <[EMAIL PROTECTED]>
> To: [EMAIL PROTECTED]; lars hofhansl <[EMAIL PROTECTED]>
> Cc:
> Sent: Wednesday, November 14, 2012 12:12 PM
> Subject: Re: Build failed in Jenkins: HBase-0.94 #589
>
> I agree. +1
>
> We can keep a list of flaky tests so that we can fix them later on.
>
> Thanks,
> Jimmy
>
> On Wed, Nov 14, 2012 at 11:55 AM, lars hofhansl <[EMAIL PROTECTED]>
> wrote:
> > Sigh.
> >
> > It seems we're back at having a successful build being the exception
> rather than the rule.
> > In this case it was some(?) timeout (all tests ran and passed), but many
> previous runs had at least one test failing.
> >
> > Flaky tests are useless. They do not add confidence to a run, and worse
> they add noise, which requires us to manually filter the good from the bad
> runs but looking at the results.
> >
> > There was talk about separating the flaky tests from the good ones.
> > Short term I propose to disable or remove every test that failed more
> than once in the last 10 runs.
> >
> >
> > This is getting quite frustrating.
> >
> > -- Lars
> >
> >
> > ----- Original Message -----
> > From: Apache Jenkins Server <[EMAIL PROTECTED]>
> > To: [EMAIL PROTECTED]
> > Cc:
> > Sent: Wednesday, November 14, 2012 11:13 AM
> > Subject: Build failed in Jenkins: HBase-0.94 #589
> >
> > See <https://builds.apache.org/job/HBase-0.94/589/>
> >
+
ramkrishna vasudevan 2012-11-17, 05:04
+
lars hofhansl 2012-12-31, 03:22
+
Stack 2012-12-19, 16:19
+
lars hofhansl 2012-12-28, 07:53
+
lars hofhansl 2012-12-28, 08:27
+
lars hofhansl 2012-12-29, 07:31
+
lars hofhansl 2012-12-29, 07:42
+
Stack 2012-12-26, 18:58
+
lars hofhansl 2012-12-26, 19:14
+
Stack 2012-12-26, 19:27
+
lars hofhansl 2012-12-26, 19:57
+
Ted Yu 2013-01-17, 15:17
+
Jean-Marc Spaggiari 2013-01-17, 15:22
+
lars hofhansl 2013-02-02, 05:53
+
Matteo Bertozzi 2013-03-04, 13:37
+
Stack 2013-03-04, 18:03
+
lars hofhansl 2013-03-05, 02:15
+
Stack 2013-03-07, 07:37
+
lars hofhansl 2013-03-07, 19:07
+
Stack 2013-03-08, 17:23
+
ramkrishna vasudevan 2013-03-08, 17:26
+
Matteo Bertozzi 2013-03-08, 17:40
+
Ted Yu 2013-03-08, 17:50
+
Stack 2013-03-08, 18:13
+
Stack 2013-03-09, 04:11
+
Stack 2013-03-09, 16:38
+
Ted Yu 2013-03-12, 04:36
+
Andrew Purtell 2013-03-12, 04:42
+
Ted Yu 2013-03-12, 04:50
+
ramkrishna vasudevan 2013-03-13, 17:51
+
Ted Yu 2013-03-13, 18:30
+
Vikas Jadhav 2013-03-12, 05:41
+
lars hofhansl 2013-03-12, 05:53
+
Ted Yu 2013-03-19, 14:29
+
Andrew Purtell 2013-03-19, 15:39
+
Ted Yu 2013-03-19, 16:20
+
Ted Yu 2013-03-19, 16:24
+
Andrew Purtell 2013-03-19, 16:49
+
ramkrishna vasudevan 2013-03-19, 16:54
+
Ted Yu 2013-03-19, 16:59
+
lars hofhansl 2013-03-19, 18:17
+
Ted Yu 2013-03-19, 21:12
+
lars hofhansl 2013-03-19, 22:50
+
Ted Yu 2013-03-19, 22:53
+
lars hofhansl 2013-03-19, 23:45
+
Stack 2013-03-23, 21:43
+
Sergey Shelukhin 2013-04-10, 00:01
+
Ted Yu 2013-04-10, 00:08
+
Stack 2013-04-10, 06:35
+
Nicolas Liochon 2013-04-10, 07:16
+
Stack 2013-04-10, 16:38
+
Sergey Shelukhin 2013-04-10, 18:43
+
Nicolas Liochon 2013-04-10, 19:04
+
Sergey Shelukhin 2013-04-10, 19:45
+
Ted Yu 2013-04-10, 19:52
+
Stack 2013-04-10, 20:03
+
Jean-Daniel Cryans 2013-04-23, 20:21
+
Stack 2013-04-24, 15:40
+
Andrew Purtell 2013-04-25, 01:02
+
Jonathan Hsieh 2013-05-02, 14:03
+
Jonathan Hsieh 2013-05-02, 14:00
+
Jonathan Hsieh 2013-05-02, 13:52
+
Jonathan Hsieh 2013-05-02, 14:20
+
Jonathan Hsieh 2013-05-02, 14:38
+
Jonathan Hsieh 2013-05-04, 18:20
+
Jonathan Hsieh 2013-05-04, 18:23
+
Jonathan Hsieh 2013-05-07, 13:17
+
Jonathan Hsieh 2013-05-07, 13:16
+
Jonathan Hsieh 2013-05-07, 13:15
+
Jonathan Hsieh 2013-05-07, 13:14
+
Jonathan Hsieh 2013-05-07, 13:19
+
Jonathan Hsieh 2013-05-06, 21:18
+
Jonathan Hsieh 2013-05-06, 21:17
+
Jonathan Hsieh 2013-05-06, 21:16
+
Jonathan Hsieh 2013-05-06, 21:12
+
Jonathan Hsieh 2013-05-06, 21:20
+
Sergey Shelukhin 2013-05-06, 22:01
+
Jonathan Hsieh 2013-05-07, 13:39
+
Jonathan Hsieh 2013-05-06, 21:19
+
Jonathan Hsieh 2013-05-08, 17:00
+
Jonathan Hsieh 2013-05-08, 16:59
+
Jonathan Hsieh 2013-05-08, 16:55
+
Jonathan Hsieh 2013-05-08, 16:57
+
Jonathan Hsieh 2013-05-08, 16:54
+
Stack 2013-05-09, 04:02
+
Stack 2013-05-09, 04:17
+
Stack 2013-05-09, 04:16
+
Stack 2013-05-09, 04:08
+
Andrew Purtell 2013-05-09, 07:35
+
Andrew Purtell 2013-05-09, 08:23
+
Ted Yu 2013-05-09, 09:07
+
Andrew Purtell 2013-05-09, 09:10
+
Ted Yu 2013-05-09, 09:18
+
Andrew Purtell 2013-05-09, 09:20
+
Andrew Purtell 2013-05-10, 10:48
+
Jonathan Hsieh 2013-05-09, 12:52
+
Jonathan Hsieh 2013-05-09, 12:51
+
Jonathan Hsieh 2013-05-09, 12:50
+
Jonathan Hsieh 2013-05-09, 12:48
+
Jonathan Hsieh 2013-05-09, 12:45
+
Jonathan Hsieh 2013-05-09, 12:44
+
Jonathan Hsieh 2013-05-09, 12:43
+
Stack 2013-05-15, 19:38
+
Stack 2013-05-15, 18:19
+
Ted Yu 2013-05-15, 18:26
+
Stack 2013-05-15, 18:32
+
Ted Yu 2013-05-15, 18:43
+
Jonathan Hsieh 2013-05-15, 19:23
+
Stack 2013-05-15, 18:06
+
Stack 2013-05-15, 08:31
+
Stack 2013-05-15, 23:41
+
Elliott Clark 2013-05-16, 00:01
+
Stack 2013-05-16, 21:42
+
Ted Yu 2013-05-17, 23:07
+
Stack 2013-05-18, 03:27
+
Stack 2013-05-24, 05:17
+
lars hofhansl 2013-05-25, 07:22
+
Ted Yu 2013-05-25, 15:52
+
lars hofhansl 2013-05-29, 00:54
+
Andrew Purtell 2013-05-29, 15:05
+
Andrew Purtell 2013-05-29, 15:12
+
lars hofhansl 2013-05-29, 17:39
+
Andrew Purtell 2013-06-11, 02:35
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB