lucene-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Muir (JIRA)" <>
Subject [jira] [Commented] (LUCENE-4463) add support for running the same test method many times
Date Sat, 06 Oct 2012 07:38:02 GMT


Robert Muir commented on LUCENE-4463:

And just to give a little more background, I mean the stuff we are dealing with is really
crazy in some sense.

You don't see the normal jenkins servers emitting failures: what happened is we realized we
weren't really testing XYZ
that we thought we were testing for months: I'm trying to help make up for lost time :(

So all these failures you have seen this week have been typically nasty-to-debug hard-to-reproduce
long-tail failures
that would normally take a ton of time to show up: Its just been Mike debugging and fixing
and me trying to figure
out more ways to provoke these failures in a more efficient way, like good-cop/bad-cop

> add support for running the same test method many times
> -------------------------------------------------------
>                 Key: LUCENE-4463
>                 URL:
>             Project: Lucene - Core
>          Issue Type: Wish
>          Components: general/build
>            Reporter: Robert Muir
>         Attachments: LUCENE-4463.patch
> I have a shell script for this, mike has a python script, its annoying :)
> I want to do something like this:
> ant beast -Dtestcase=XXXX -Dtestmethod=YYYY -Diterations=100
> I would be happy with a simple loop that just invokes 'test' somehow: getting a fresh
new JVM to each iteration is desirable anyway (so you get fresh codecs, etc). 
> the -Dtests.iters is not really useful for this because it does not allow -Dtestmethod
and it does not give a fresh jvm.
> bonus points if it can use multiple jvms at the same time though :)

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see:

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message