Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Accumulo, mail # dev - Integration Tests


Copy link to this message
-
Re: integration tests
Eric Newton 2013-10-07, 15:17
If a couple people try it and it works for them, then sure!

Does it work for you?

-Eric
On Mon, Oct 7, 2013 at 11:09 AM, Michael Berman <[EMAIL PROTECTED]> wrote:
> This is awesome; thanks Eric!
>
> Should we set perCoreThreadCount for failsafe so people can take advantage
> of the parallel speedup without having to remember to set accumulo.it.forkCount
> manually?  If we set it to something relatively small, it shouldn't break
> things on slow VMs, but would still benefit devs with beefier machines.
>
> Also, any reason not to set reuseForks?  Running from an IDE always reuses
> the VM, and seems to work just fine.  This would also let us keep recycling
> the same static minicluster between testclasses, which is no longer
> happening in maven (although still happens in eclipse).
>
>
> On Sun, Oct 6, 2013 at 12:25 AM, Christopher <[EMAIL PROTECTED]> wrote:
>
>> That doesn't work well with plugins that aren't all thread safe, and
>> may have other side-effects. Feel free to try it, if you like, but I
>> think it's sufficient to focus on optimizing the unit tests and
>> integration tests, because that's where it really matters.
>>
>> --
>> Christopher L Tubbs II
>> http://gravatar.com/ctubbsii
>>
>>
>> On Fri, Sep 27, 2013 at 5:53 PM, Mike Drob <[EMAIL PROTECTED]> wrote:
>> > Maven already provides a -T option for multithreaded runs, and can even
>> > take a core multiplied factor. It would be nice to integrate with that in
>> > some way
>> > That's much better. It took me a few iterations to get down to an
>> > appropriate number of threads where it wouldn't fail, but being able to
>> do
>> > it in 20 minutes blows 1+ hours out of the water
>> >
>> >
>> > On Fri, Sep 27, 2013 at 2:55 PM, Eric Newton <[EMAIL PROTECTED]>
>> wrote:
>> >
>> >> I've stabilized the integration tests. They run in a slow virtual
>> machine,
>> >> and they run on my desktop.  You can use multiple forks to run the tests
>> >> more quickly:
>> >>
>> >>  $ mvn clean verify -Pnative -Daccumulo.it.forkCount=12
>> >>
>> >> That takes ~15 minutes.  My desktop has 8 cores and 30G of RAM.
>> >>
>> >> Please take the time to run the integration tests, and please open
>> tickets
>> >> if you find them failing.
>> >>
>> >> I'm not going to turn these tests on for our Jenkin's build because they
>> >> will still timeout.
>> >>
>> >> -Eric
>> >>
>>