The total number of tests that are expected to run when this Suite
's run
method is invoked.
The total number of tests that are expected to run when this Suite
's run
method is invoked.
a Filter
with which to filter tests to count based on their tags
An immutable IndexedSeq
of this SuiteMixin
object's nested Suite
s.
An immutable IndexedSeq
of this SuiteMixin
object's nested Suite
s. If this SuiteMixin
contains no nested Suite
s,
this method returns an empty IndexedSeq
.
The fully qualified name of the class that can be used to rerun this suite.
The fully qualified name of the class that can be used to rerun this suite.
Runs this suite of tests.
Runs this suite of tests.
an optional name of one test to execute. If None
, all relevant tests should be executed.
I.e., None
acts like a wildcard that means execute all relevant tests in this Suite
.
the Args
for this run
a Status
object that indicates when all tests and nested suites started by this method have completed, and whether or not a failure occurred.
Runs zero to many of this suite's nested suites.
Runs zero to many of this suite's nested suites.
the Args
for this run
a Status
object that indicates when all nested suites started by this method have completed, and whether or not a failure occurred.
Runs a test.
Runs a test.
the name of one test to execute.
the Args
for this run
a Status
object that indicates when the test started by this method has completed, and whether or not it failed .
Runs zero to many of this suite's tests.
Runs zero to many of this suite's tests.
an optional name of one test to run. If None
, all relevant tests should be run.
I.e., None
acts like a wildcard that means run all relevant tests in this Suite
.
the Args
for this run
a Status
object that indicates when all tests started by this method have completed, and whether or not a failure occurred.
This suite's style name.
This suite's style name.
This lifecycle method provides a string that is used to determine whether this suite object's style is one of the chosen styles for the project.
A Map
whose keys are String
tag names with which tests in this Suite
are marked, and
whose values are the Set
of test names marked with each tag.
A Map
whose keys are String
tag names with which tests in this Suite
are marked, and
whose values are the Set
of test names marked with each tag. If this Suite
contains no tags, this
method returns an empty Map
.
Subclasses may implement this method to define and/or discover tags in a custom manner, but overriding method implementations
should never return an empty Set
as a value. If a tag has no tests, its name should not appear as a key in the
returned Map
.
A Set
of test names.
A Set
of test names. If this Suite
contains no tests, this method returns an empty Set
.
Although subclass and subtrait implementations of this method may return a Set
whose iterator produces String
test names in a well-defined order, the contract of this method does not required a defined order. Subclasses are free to
implement this method and return test names in either a defined or undefined order.
The time limit, in milliseconds, in which each test in a Suite
that mixes in
TimeLimitedTests
must complete.
The time limit, in milliseconds, in which each test in a Suite
that mixes in
TimeLimitedTests
must complete.
The default Interruptor
strategy used to interrupt tests that exceed their time limit.
The default Interruptor
strategy used to interrupt tests that exceed their time limit.
This trait's implementation of this method returns ThreadInterruptor
, which invokes interrupt
on the main test thread. Override this method to change the test interruption strategy.
a ThreadInterruptor
A stackable implementation of withFixture
that wraps a call to super.withFixture
in a
failAfter
invocation.
A stackable implementation of withFixture
that wraps a call to super.withFixture
in a
failAfter
invocation.
the test on which to enforce a time limit
Trait that when mixed into a suite class establishes a time limit for its tests.
This trait overrides
withFixture
, wrapping asuper.withFixture(test)
call in afailAfter
invocation, specifying a timeout obtained by invokingtimeLimit
and anInterruptor
by invokingdefaultTestInterruptor
:failAfter(timeLimit) { super.withFixture(test) } (defaultTestInterruptor)
Note that the
failAfter
method executes the body of the by-name passed to it using the same thread that invokedfailAfter
. This means that the same thread will run thewithFixture
method as well as each test, so no extra synchronization is required. A second thread is used to run a timer, and if the timeout expires, that second thread will attempt to interrupt the main test thread via thedefaultTestInterruptor
.The
timeLimit
field is abstract in this trait. Thus you must specify a time limit when you use it. For example, the following code specifies that each test must complete within 200 milliseconds:If you run the above
ExampleSpec
, the second test will fail with the error message:The test did not complete within the specified 200 millisecond time limit.
The
failAfter
method uses anInterruptor
to attempt to interrupt the main test thread if the timeout expires. The defaultInterruptor
returned by thedefaultTestInterruptor
method is aThreadInterruptor
, which callsinterrupt
on the main test thread. If you wish to change this interruption strategy, overridedefaultTestInterruptor
to return a differentInterruptor
. For example, here's how you'd change the default toDoNotInterrupt
, a very patient interruption strategy that does nothing to interrupt the main test thread:Like the previous incarnation of
ExampleSuite
, the second test will fail with an error message that indicates a timeout expired. But whereas in the previous case, theThread.sleep
would be interrupted after 200 milliseconds, in this case it is never interrupted. In the previous case, the failed test requires a little over 200 milliseconds to run. In this case, because thesleep(300)
is never interrupted, the failed test requires a little over 300 milliseconds to run.