com.carrotsearch.examples.randomizedrunner

Class Test006RepeatingTests

java.lang.Object

org.junit.Assert

com.carrotsearch.randomizedtesting.RandomizedTest

com.carrotsearch.examples.randomizedrunner.Test006RepeatingTests

public class Test006RepeatingTests
extends RandomizedTest

In example Test005RecoveringRandomSeed we presented Randomness contexts and how they are derived from a master seed. Once you know a certain test case fails it is usually beneficial to immediately check if it always fails on a given seed (which means there is a deterministic failure scenario). A simple way to do so would be to re-run a test case a few times. The same effect can be achieved by adding a Repeat annotation with Repeat.useConstantSeed() set to false attribute as shown in the method repeatFailure() below.

 @Repeat(iterations = 5, useConstantSeed = true)
 @Seed("f00ddead")
 @Test
 public void repeatFailure() { //...
 

Note how the seed is fixed using Seed annotation (on the method) rather than on the master. This ensures the method's context is pinned to that value, but the master is still random. If you have BeforeClass hooks that depend on randomness you should use suite-level Seed annotation and pin the master seed instead.

You can also set Repeat.useConstantSeed() to false and then every iteration of the test method will have a pseudo-random context derived from the first one (pinned or not). This can be useful to tell how frequently a given test case fails for a random seed. For halfAndHalf() method about 50% of iterations will fail.

Field Summary

Fields inherited from class com.carrotsearch.randomizedtesting.RandomizedTest

ISO8859_1, SYSPROP_MULTIPLIER, US_ASCII, UTF16, UTF32, UTF8

Constructor Summary

Constructors

Constructor and Description
Test006RepeatingTests()

Method Summary

Methods

Modifier and Type	Method and Description
void	halfAndHalf()
void	repeatFailure()

Methods inherited from class com.carrotsearch.randomizedtesting.RandomizedTest

$, $$, assumeFalse, assumeFalse, assumeNoException, assumeNoException, assumeNotNull, assumeTrue, assumeTrue, atLeast, atMost, between, closeAfterSuite, closeAfterTest, frequently, getContext, getRandom, globalTempDir, isNightly, iterations, multiplier, newServerSocket, newTempDir, newTempDir, newTempFile, newTempFile, randomAsciiOfLength, randomAsciiOfLengthBetween, randomBoolean, randomByte, randomDouble, randomFloat, randomFrom, randomFrom, randomGaussian, randomInt, randomInt, randomIntBetween, randomLocale, randomLong, randomRealisticUnicodeOfCodepointLength, randomRealisticUnicodeOfCodepointLengthBetween, randomRealisticUnicodeOfLength, randomRealisticUnicodeOfLengthBetween, randomShort, randomTimeZone, randomUnicodeOfCodepointLength, randomUnicodeOfCodepointLengthBetween, randomUnicodeOfLength, randomUnicodeOfLengthBetween, rarely, scaledRandomIntBetween, sleep, systemPropertyAsBoolean, systemPropertyAsDouble, systemPropertyAsFloat, systemPropertyAsInt, systemPropertyAsLong

Methods inherited from class org.junit.Assert

assertArrayEquals, assertArrayEquals, assertArrayEquals, assertArrayEquals, assertArrayEquals, assertArrayEquals, assertArrayEquals, assertArrayEquals, assertArrayEquals, assertArrayEquals, assertArrayEquals, assertArrayEquals, assertArrayEquals, assertArrayEquals, assertArrayEquals, assertArrayEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertFalse, assertFalse, assertNotNull, assertNotNull, assertNotSame, assertNotSame, assertNull, assertNull, assertSame, assertSame, assertThat, assertThat, assertTrue, assertTrue, fail, fail

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

Test006RepeatingTests

public Test006RepeatingTests()

Method Detail

repeatFailure

@Seed(value="f00ddead")
public void repeatFailure()

halfAndHalf

public void halfAndHalf()