diff --git a/CHANGELOG.md b/CHANGELOG.md index 1646e3e4..22c6cee4 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -8,6 +8,10 @@ The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/), For a full diff see [`2.8.0...main`][2.8.0...main]. +### Changed + +- Consistently included test setup and teardown in duration measurement ([#380]), by [@localheinz] and [@mvorisek] + ### Fixed - Required at least `phpunit/phpunit:^7.5.0` ([#448]), by [@localheinz] diff --git a/README.md b/README.md index 40007c09..d06e24e1 100644 --- a/README.md +++ b/README.md @@ -376,7 +376,7 @@ When using `phpunit/phpunit:^7.5.0`, `phpunit/phpunit:^8.5.19`, or `phpunit/phpu The hooks event system supports eleven hook methods that `phpunit/phpunit` invokes during the execution of tests. -When the extension uses the hooks event system, it uses the [`PHPUnit\Runner\AfterSuccessfulTestHook`](https://github.com/sebastianbergmann/phpunit/blob/8.5.19/src/Runner/Hook/AfterSuccessfulTestHook.php#L12-L15), which receives the [duration of invoking `PHPUnit\Framework\TestCase::runBare()` and more](https://github.com/sebastianbergmann/phpunit/blob/8.5.19/src/Framework/TestResult.php#L671-L754). +When the extension uses the hooks event system, it uses the [`PHPUnit\Runner\AfterTestHook`](https://github.com/sebastianbergmann/phpunit/blob/7.5.0/src/Runner/Hook/AfterTestHook.php#L12-L21), which receives the [duration of invoking `PHPUnit\Framework\TestCase::runBare()` and more](https://github.com/sebastianbergmann/phpunit/blob/8.5.19/src/Framework/TestResult.php#L671-L754). When `phpunit/phpunit` invokes `PHPUnit\Framework\TestCase::runBare()`, it will invoke the following methods before the first test method in the class: @@ -405,7 +405,28 @@ When using `phpunit/phpunit:^10.0.0`, the extension uses the new event system of The new event system supports a wide range of events that `phpunit/phpunit` emits during the execution of tests. -When the extension uses the new event system, it uses and subscribes to the [`PHPUnit\Event\Test\Prepared`](https://github.com/sebastianbergmann/phpunit/blob/10.0.0/src/Event/Events/Test/Lifecycle/Prepared.php#L22-L50) and [`PHPUnit\Event\Test\Passed`](https://github.com/sebastianbergmann/phpunit/blob/10.0.0/src/Event/Events/Test/Outcome/Passed.php#L22-L50) events and measures the [duration between the points in time when `phpunit/phpunit` emits the former and the latter](https://github.com/sebastianbergmann/phpunit/blob/10.0.0/src/Framework/TestCase.php#L614-L666). +When the extension uses the new event system, it uses and subscribes to the [`PHPUnit\Event\Test\PreparationStarted`](https://github.com/sebastianbergmann/phpunit/blob/10.0.0/src/Event/Events/Test/Lifecycle/PreparationStarted.php#L22-L50) and [`PHPUnit\Event\Test\Finished`](https://github.com/sebastianbergmann/phpunit/blob/10.0.0/src/Event/Events/Test/Lifecycle/Finished.php#L22-L57) events and measures the duration between the points in time when `phpunit/phpunit` emits the former and the latter. + +When `phpunit/phpunit` invokes `PHPUnit\Framework\TestCase::runBare()`, it will invoke the following methods before the first test method in the class: + +- [`PHPUnit\Framework\TestCase::setUpBeforeClass()` and methods annotated with `@beforeClass`](https://github.com/sebastianbergmann/phpunit/blob/10.0.0/src/Framework/TestCase.php#L602-L604) + +When `phpunit/phpunit` invokes `PHPUnit\Framework\TestCase::runBare()`, it will invoke the following methods before every test method in the class: + +- [`PHPUnit\Framework\TestCase::setUp()` and methods annotated with `@before`](https://github.com/sebastianbergmann/phpunit/blob/10.0.0/src/Framework/TestCase.php#L611) +- [`PHPUnit\Framework\TestCase::assertPreConditions()`](https://github.com/sebastianbergmann/phpunit/blob/10.0.0/src/Framework/TestCase.php#L612) + +When `phpunit/phpunit` invokes `PHPUnit\Framework\TestCase::runBare()`, it will invoke the following methods after every test method in the class: + +- [`PHPUnit\Framework\TestCase::assertPostConditions()`](https://github.com/sebastianbergmann/phpunit/blob/10.0.0/src/Framework/TestCase.php#L622) +- [`PHPUnit\Framework\TestCase::tearDown()` and methods annotated with `@after`](https://github.com/sebastianbergmann/phpunit/blob/10.0.0/src/Framework/TestCase.php#L680) + +When phpunit/phpunit invokes `PHPUnit\Framework\TestCase::runBare()`, it will invoke the following methods after the last test method in the class: + +- [`PHPUnit\Framework\TestCase::tearDownAfterClass()` and methods annotated with `@afterClass`](https://github.com/sebastianbergmann/phpunit/blob/10.0.0/src/Framework/TestCase.php#L683) + +> [!NOTE] +> Because of this behavior, the measured test durations can and will vary depending on the order in which `phpunit/phpunit` executes tests. ## Changelog diff --git a/composer-require-checker.json b/composer-require-checker.json index e3e16b98..0e748b90 100644 --- a/composer-require-checker.json +++ b/composer-require-checker.json @@ -7,10 +7,10 @@ "int", "null", "PHPUnit\\Event\\Code\\Test", - "PHPUnit\\Event\\Test\\Passed", - "PHPUnit\\Event\\Test\\PassedSubscriber", - "PHPUnit\\Event\\Test\\Prepared", - "PHPUnit\\Event\\Test\\PreparedSubscriber", + "PHPUnit\\Event\\Test\\Finished", + "PHPUnit\\Event\\Test\\FinishedSubscriber", + "PHPUnit\\Event\\Test\\PreparationStarted", + "PHPUnit\\Event\\Test\\PreparationStartedSubscriber", "PHPUnit\\Event\\TestRunner\\ExecutionFinished", "PHPUnit\\Event\\TestRunner\\ExecutionFinishedSubscriber", "PHPUnit\\Metadata\\Annotation\\Parser\\Registry", diff --git a/psalm-baseline.xml b/psalm-baseline.xml index f169533c..116580e7 100644 --- a/psalm-baseline.xml +++ b/psalm-baseline.xml @@ -21,12 +21,12 @@ ($durationInMilliseconds - $hoursInMilliseconds - $minutesInMilliseconds) / 1_000 - + - Event\Test\PassedSubscriber + Event\Test\FinishedSubscriber - PassedSubscriber + FinishedSubscriber $collector @@ -35,12 +35,12 @@ $timeKeeper - + - Event\Test\PreparedSubscriber + Event\Test\PreparationStartedSubscriber - PreparedSubscriber + PreparationStartedSubscriber $event diff --git a/src/Extension.php b/src/Extension.php index c2c69ce6..c04a0d8b 100644 --- a/src/Extension.php +++ b/src/Extension.php @@ -33,6 +33,7 @@ final class Extension implements Runner\AfterLastTestHook, Runner\AfterSuccessfulTestHook, + Runner\AfterTestHook, Runner\BeforeFirstTestHook { private int $suites = 0; @@ -68,9 +69,21 @@ public function executeBeforeFirstTest(): void ++$this->suites; } + /** + * @see https://github.com/sebastianbergmann/phpunit/pull/3392#issuecomment-1868311482 + * @see https://github.com/sebastianbergmann/phpunit/blob/7.5.0/src/TextUI/TestRunner.php#L227-L239 + * @see https://github.com/sebastianbergmann/phpunit/pull/3762 + */ public function executeAfterSuccessfulTest( string $test, float $time + ): void { + // intentionally left blank + } + + public function executeAfterTest( + string $test, + float $time ): void { $seconds = (int) \floor($time); $nanoseconds = (int) (($time - $seconds) * 1_000_000_000); @@ -206,8 +219,8 @@ public function bootstrap( ); $facade->registerSubscribers( - new Subscriber\Test\PreparedSubscriber($timeKeeper), - new Subscriber\Test\PassedSubscriber( + new Subscriber\Test\PreparationStartedSubscriber($timeKeeper), + new Subscriber\Test\FinishedSubscriber( $maximumDuration, $timeKeeper, $collector, diff --git a/src/Subscriber/Test/PassedSubscriber.php b/src/Subscriber/Test/FinishedSubscriber.php similarity index 94% rename from src/Subscriber/Test/PassedSubscriber.php rename to src/Subscriber/Test/FinishedSubscriber.php index 17b60e95..d52c21c8 100644 --- a/src/Subscriber/Test/PassedSubscriber.php +++ b/src/Subscriber/Test/FinishedSubscriber.php @@ -27,7 +27,7 @@ /** * @internal */ -final class PassedSubscriber implements Event\Test\PassedSubscriber +final class FinishedSubscriber implements Event\Test\FinishedSubscriber { private Collector\Collector $collector; private TimeKeeper $timeKeeper; @@ -44,9 +44,10 @@ public function __construct( } /** - * @see https://github.com/sebastianbergmann/phpunit/blob/10.0.0/src/Framework/TestCase.php#L664-L666 + * @see https://github.com/sebastianbergmann/phpunit/blob/10.0.0/src/Framework/TestRunner.php#L198 + * @see https://github.com/sebastianbergmann/phpunit/blob/10.0.0/src/Framework/TestRunner.php#L238 */ - public function notify(Event\Test\Passed $event): void + public function notify(Event\Test\Finished $event): void { $phaseIdentifier = PhaseIdentifier::fromString($event->test()->id()); diff --git a/src/Subscriber/Test/PreparedSubscriber.php b/src/Subscriber/Test/PreparationStartedSubscriber.php similarity index 83% rename from src/Subscriber/Test/PreparedSubscriber.php rename to src/Subscriber/Test/PreparationStartedSubscriber.php index c29c5af2..61d43302 100644 --- a/src/Subscriber/Test/PreparedSubscriber.php +++ b/src/Subscriber/Test/PreparationStartedSubscriber.php @@ -21,7 +21,7 @@ /** * @internal */ -final class PreparedSubscriber implements Event\Test\PreparedSubscriber +final class PreparationStartedSubscriber implements Event\Test\PreparationStartedSubscriber { private TimeKeeper $timeKeeper; @@ -31,9 +31,9 @@ public function __construct(TimeKeeper $timeKeeper) } /** - * @see https://github.com/sebastianbergmann/phpunit/blob/10.0.0/src/Framework/TestCase.php#L614-L616 + * @see https://github.com/sebastianbergmann/phpunit/blob/10.0.0/src/Framework/TestCase.php#L585-L587 */ - public function notify(Event\Test\Prepared $event): void + public function notify(Event\Test\PreparationStarted $event): void { $time = $event->telemetryInfo()->time(); diff --git a/test/EndToEnd/Version10/TestCase/Combination/test.phpt b/test/EndToEnd/Version10/TestCase/Combination/test.phpt index 87345b4c..7a4b339b 100644 --- a/test/EndToEnd/Version10/TestCase/Combination/test.phpt +++ b/test/EndToEnd/Version10/TestCase/Combination/test.phpt @@ -24,9 +24,9 @@ Configuration: %s/EndToEnd/Version10/TestCase/Combination/phpunit.xml Detected 3 tests that took longer than expected. -1. 0.4%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestCase\Combination\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#1 -2. 0.3%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestCase\Combination\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#0 -3. 0.1%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestCase\Combination\SleeperTest::testSleeperSleepsLessThanMaximumDurationFromXmlConfiguration +1. 1.1%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestCase\Combination\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#1 +2. 1.0%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestCase\Combination\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#0 +3. 0.8%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestCase\Combination\SleeperTest::testSleeperSleepsLessThanMaximumDurationFromXmlConfiguration Time: %s, Memory: %s diff --git a/test/EndToEnd/Version10/TestCase/WithAfterAnnotation/test.phpt b/test/EndToEnd/Version10/TestCase/WithAfterAnnotation/test.phpt index 30bb15bd..13d5d4f9 100644 --- a/test/EndToEnd/Version10/TestCase/WithAfterAnnotation/test.phpt +++ b/test/EndToEnd/Version10/TestCase/WithAfterAnnotation/test.phpt @@ -22,10 +22,11 @@ Configuration: %s/EndToEnd/Version10/TestCase/WithAfterAnnotation/phpunit.xml ... 3 / 3 (100%) -Detected 2 tests that took longer than expected. +Detected 3 tests that took longer than expected. -1. 0.3%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestCase\WithAfterAnnotation\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#1 -2. 0.2%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestCase\WithAfterAnnotation\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#0 +1. 0.4%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestCase\WithAfterAnnotation\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#1 +2. 0.3%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestCase\WithAfterAnnotation\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#0 +3. 0.1%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestCase\WithAfterAnnotation\SleeperTest::testSleeperSleepsLessThanMaximumDurationFromXmlConfiguration Time: %s, Memory: %s diff --git a/test/EndToEnd/Version10/TestCase/WithAfterAttribute/test.phpt b/test/EndToEnd/Version10/TestCase/WithAfterAttribute/test.phpt index bfac280a..f90511ed 100644 --- a/test/EndToEnd/Version10/TestCase/WithAfterAttribute/test.phpt +++ b/test/EndToEnd/Version10/TestCase/WithAfterAttribute/test.phpt @@ -22,10 +22,11 @@ Configuration: %s/EndToEnd/Version10/TestCase/WithAfterAttribute/phpunit.xml ... 3 / 3 (100%) -Detected 2 tests that took longer than expected. +Detected 3 tests that took longer than expected. -1. 0.3%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestCase\WithAfterAttribute\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#1 -2. 0.2%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestCase\WithAfterAttribute\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#0 +1. 0.4%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestCase\WithAfterAttribute\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#1 +2. 0.3%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestCase\WithAfterAttribute\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#0 +3. 0.1%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestCase\WithAfterAttribute\SleeperTest::testSleeperSleepsLessThanMaximumDurationFromXmlConfiguration Time: %s, Memory: %s diff --git a/test/EndToEnd/Version10/TestCase/WithAssertPreConditions/test.phpt b/test/EndToEnd/Version10/TestCase/WithAssertPreConditions/test.phpt index 06edab39..4717f9b1 100644 --- a/test/EndToEnd/Version10/TestCase/WithAssertPreConditions/test.phpt +++ b/test/EndToEnd/Version10/TestCase/WithAssertPreConditions/test.phpt @@ -22,10 +22,11 @@ Configuration: %s/EndToEnd/Version10/TestCase/WithAssertPreConditions/phpunit.xm ... 3 / 3 (100%) -Detected 2 tests that took longer than expected. +Detected 3 tests that took longer than expected. -1. 0.3%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestCase\WithAssertPreConditions\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#1 -2. 0.2%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestCase\WithAssertPreConditions\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#0 +1. 0.4%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestCase\WithAssertPreConditions\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#1 +2. 0.3%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestCase\WithAssertPreConditions\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#0 +3. 0.1%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestCase\WithAssertPreConditions\SleeperTest::testSleeperSleepsLessThanMaximumDurationFromXmlConfiguration Time: %s, Memory: %s diff --git a/test/EndToEnd/Version10/TestCase/WithBeforeAnnotation/test.phpt b/test/EndToEnd/Version10/TestCase/WithBeforeAnnotation/test.phpt index 4b423c59..ffd2a430 100644 --- a/test/EndToEnd/Version10/TestCase/WithBeforeAnnotation/test.phpt +++ b/test/EndToEnd/Version10/TestCase/WithBeforeAnnotation/test.phpt @@ -22,10 +22,11 @@ Configuration: %s/EndToEnd/Version10/TestCase/WithBeforeAnnotation/phpunit.xml ... 3 / 3 (100%) -Detected 2 tests that took longer than expected. +Detected 3 tests that took longer than expected. -1. 0.3%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestCase\WithBeforeAnnotation\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#1 -2. 0.2%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestCase\WithBeforeAnnotation\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#0 +1. 0.4%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestCase\WithBeforeAnnotation\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#1 +2. 0.3%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestCase\WithBeforeAnnotation\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#0 +3. 0.1%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestCase\WithBeforeAnnotation\SleeperTest::testSleeperSleepsLessThanMaximumDurationFromXmlConfiguration Time: %s, Memory: %s diff --git a/test/EndToEnd/Version10/TestCase/WithBeforeAttribute/test.phpt b/test/EndToEnd/Version10/TestCase/WithBeforeAttribute/test.phpt index 1efc4505..35f8cce7 100644 --- a/test/EndToEnd/Version10/TestCase/WithBeforeAttribute/test.phpt +++ b/test/EndToEnd/Version10/TestCase/WithBeforeAttribute/test.phpt @@ -22,10 +22,11 @@ Configuration: %s/EndToEnd/Version10/TestCase/WithBeforeAttribute/phpunit.xml ... 3 / 3 (100%) -Detected 2 tests that took longer than expected. +Detected 3 tests that took longer than expected. -1. 0.3%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestCase\WithBeforeAttribute\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#1 -2. 0.2%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestCase\WithBeforeAttribute\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#0 +1. 0.4%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestCase\WithBeforeAttribute\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#1 +2. 0.3%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestCase\WithBeforeAttribute\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#0 +3. 0.1%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestCase\WithBeforeAttribute\SleeperTest::testSleeperSleepsLessThanMaximumDurationFromXmlConfiguration Time: %s, Memory: %s diff --git a/test/EndToEnd/Version10/TestCase/WithSetUp/test.phpt b/test/EndToEnd/Version10/TestCase/WithSetUp/test.phpt index 9e5bfff1..09d60e9f 100644 --- a/test/EndToEnd/Version10/TestCase/WithSetUp/test.phpt +++ b/test/EndToEnd/Version10/TestCase/WithSetUp/test.phpt @@ -22,10 +22,11 @@ Configuration: %s/EndToEnd/Version10/TestCase/WithSetUp/phpunit.xml ... 3 / 3 (100%) -Detected 2 tests that took longer than expected. +Detected 3 tests that took longer than expected. -1. 0.3%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestCase\WithSetUp\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#1 -2. 0.2%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestCase\WithSetUp\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#0 +1. 0.4%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestCase\WithSetUp\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#1 +2. 0.3%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestCase\WithSetUp\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#0 +3. 0.1%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestCase\WithSetUp\SleeperTest::testSleeperSleepsLessThanMaximumDurationFromXmlConfiguration Time: %s, Memory: %s diff --git a/test/EndToEnd/Version10/TestCase/WithTearDown/test.phpt b/test/EndToEnd/Version10/TestCase/WithTearDown/test.phpt index d172482c..fdd6e996 100644 --- a/test/EndToEnd/Version10/TestCase/WithTearDown/test.phpt +++ b/test/EndToEnd/Version10/TestCase/WithTearDown/test.phpt @@ -22,10 +22,11 @@ Configuration: %s/EndToEnd/Version10/TestCase/WithTearDown/phpunit.xml ... 3 / 3 (100%) -Detected 2 tests that took longer than expected. +Detected 3 tests that took longer than expected. -1. 0.3%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestCase\WithTearDown\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#1 -2. 0.2%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestCase\WithTearDown\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#0 +1. 0.4%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestCase\WithTearDown\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#1 +2. 0.3%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestCase\WithTearDown\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#0 +3. 0.1%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestCase\WithTearDown\SleeperTest::testSleeperSleepsLessThanMaximumDurationFromXmlConfiguration Time: %s, Memory: %s diff --git a/test/EndToEnd/Version10/TestMethod/WithRunInSeparateProcessAnnotation/test.phpt b/test/EndToEnd/Version10/TestMethod/WithRunInSeparateProcessAnnotation/test.phpt index dbec1cba..fbb2d8f7 100644 --- a/test/EndToEnd/Version10/TestMethod/WithRunInSeparateProcessAnnotation/test.phpt +++ b/test/EndToEnd/Version10/TestMethod/WithRunInSeparateProcessAnnotation/test.phpt @@ -29,10 +29,10 @@ Configuration: %s/EndToEnd/Version10/TestMethod/WithRunInSeparateProcessAnnotati Detected 4 tests that took longer than expected. -1. 0.4%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestMethod\WithRunInSeparateProcessAnnotation\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWhenMethodHasRunInSeparateProcessAnnotation -2. 0.3%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestMethod\WithRunInSeparateProcessAnnotation\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfiguration -3. 0.1%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestMethod\WithRunInSeparateProcessAnnotation\SleeperTest::testSleeperSleepsShorterThanMaximumDurationFromXmlConfigurationWhenMethodHasRunInSeparateProcessAnnotation -4. 0.1%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestMethod\WithRunInSeparateProcessAnnotation\SleeperTest::testSleeperSleepsShorterThanMaximumDurationFromXmlConfiguration +1. 1.3%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestMethod\WithRunInSeparateProcessAnnotation\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWhenMethodHasRunInSeparateProcessAnnotation +2. 1.1%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestMethod\WithRunInSeparateProcessAnnotation\SleeperTest::testSleeperSleepsShorterThanMaximumDurationFromXmlConfigurationWhenMethodHasRunInSeparateProcessAnnotation +3. 1.0%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestMethod\WithRunInSeparateProcessAnnotation\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfiguration +4. 0.8%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestMethod\WithRunInSeparateProcessAnnotation\SleeperTest::testSleeperSleepsShorterThanMaximumDurationFromXmlConfiguration Time: %s, Memory: %s diff --git a/test/EndToEnd/Version10/TestMethod/WithRunInSeparateProcessAttribute/test.phpt b/test/EndToEnd/Version10/TestMethod/WithRunInSeparateProcessAttribute/test.phpt index 1f2ac175..30c1d1e7 100644 --- a/test/EndToEnd/Version10/TestMethod/WithRunInSeparateProcessAttribute/test.phpt +++ b/test/EndToEnd/Version10/TestMethod/WithRunInSeparateProcessAttribute/test.phpt @@ -29,10 +29,10 @@ Configuration: %s/EndToEnd/Version10/TestMethod/WithRunInSeparateProcessAttribut Detected 4 tests that took longer than expected. -1. 0.4%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestMethod\WithRunInSeparateProcessAttribute\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWhenMethodHasRunInSeparateProcessAttribute -2. 0.3%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestMethod\WithRunInSeparateProcessAttribute\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfiguration -3. 0.1%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestMethod\WithRunInSeparateProcessAttribute\SleeperTest::testSleeperSleepsShorterThanMaximumDurationFromXmlConfigurationWhenMethodHasRunInSeparateProcessAttribute -4. 0.1%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestMethod\WithRunInSeparateProcessAttribute\SleeperTest::testSleeperSleepsShorterThanMaximumDurationFromXmlConfiguration +1. 1.3%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestMethod\WithRunInSeparateProcessAttribute\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWhenMethodHasRunInSeparateProcessAttribute +2. 1.1%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestMethod\WithRunInSeparateProcessAttribute\SleeperTest::testSleeperSleepsShorterThanMaximumDurationFromXmlConfigurationWhenMethodHasRunInSeparateProcessAttribute +3. 1.0%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestMethod\WithRunInSeparateProcessAttribute\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfiguration +4. 0.8%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version10\TestMethod\WithRunInSeparateProcessAttribute\SleeperTest::testSleeperSleepsShorterThanMaximumDurationFromXmlConfiguration Time: %s, Memory: %s diff --git a/test/EndToEnd/Version11/TestCase/Combination/test.phpt b/test/EndToEnd/Version11/TestCase/Combination/test.phpt index bd9b36ef..a41bb0fe 100644 --- a/test/EndToEnd/Version11/TestCase/Combination/test.phpt +++ b/test/EndToEnd/Version11/TestCase/Combination/test.phpt @@ -24,9 +24,9 @@ Configuration: %s/EndToEnd/Version11/TestCase/Combination/phpunit.xml Detected 3 tests that took longer than expected. -1. 0.4%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version11\TestCase\Combination\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#1 -2. 0.3%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version11\TestCase\Combination\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#0 -3. 0.1%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version11\TestCase\Combination\SleeperTest::testSleeperSleepsLessThanMaximumDurationFromXmlConfiguration +1. 0.9%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version11\TestCase\Combination\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#1 +2. 0.8%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version11\TestCase\Combination\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#0 +3. 0.6%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version11\TestCase\Combination\SleeperTest::testSleeperSleepsLessThanMaximumDurationFromXmlConfiguration Time: %s, Memory: %s diff --git a/test/EndToEnd/Version11/TestCase/WithAfterAttribute/test.phpt b/test/EndToEnd/Version11/TestCase/WithAfterAttribute/test.phpt index 50c1d303..839ef331 100644 --- a/test/EndToEnd/Version11/TestCase/WithAfterAttribute/test.phpt +++ b/test/EndToEnd/Version11/TestCase/WithAfterAttribute/test.phpt @@ -22,10 +22,11 @@ Configuration: %s/EndToEnd/Version11/TestCase/WithAfterAttribute/phpunit.xml ... 3 / 3 (100%) -Detected 2 tests that took longer than expected. +Detected 3 tests that took longer than expected. -1. 0.3%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version11\TestCase\WithAfterAttribute\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#1 -2. 0.2%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version11\TestCase\WithAfterAttribute\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#0 +1. 0.4%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version11\TestCase\WithAfterAttribute\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#1 +2. 0.3%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version11\TestCase\WithAfterAttribute\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#0 +3. 0.1%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version11\TestCase\WithAfterAttribute\SleeperTest::testSleeperSleepsLessThanMaximumDurationFromXmlConfiguration Time: %s, Memory: %s diff --git a/test/EndToEnd/Version11/TestCase/WithAssertPreConditions/test.phpt b/test/EndToEnd/Version11/TestCase/WithAssertPreConditions/test.phpt index 2f887757..6e71ca03 100644 --- a/test/EndToEnd/Version11/TestCase/WithAssertPreConditions/test.phpt +++ b/test/EndToEnd/Version11/TestCase/WithAssertPreConditions/test.phpt @@ -22,10 +22,11 @@ Configuration: %s/EndToEnd/Version11/TestCase/WithAssertPreConditions/phpunit.xm ... 3 / 3 (100%) -Detected 2 tests that took longer than expected. +Detected 3 tests that took longer than expected. -1. 0.3%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version11\TestCase\WithAssertPreConditions\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#1 -2. 0.2%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version11\TestCase\WithAssertPreConditions\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#0 +1. 0.4%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version11\TestCase\WithAssertPreConditions\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#1 +2. 0.3%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version11\TestCase\WithAssertPreConditions\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#0 +3. 0.1%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version11\TestCase\WithAssertPreConditions\SleeperTest::testSleeperSleepsLessThanMaximumDurationFromXmlConfiguration Time: %s, Memory: %s diff --git a/test/EndToEnd/Version11/TestCase/WithBeforeAttribute/test.phpt b/test/EndToEnd/Version11/TestCase/WithBeforeAttribute/test.phpt index 3fb291ff..3053922e 100644 --- a/test/EndToEnd/Version11/TestCase/WithBeforeAttribute/test.phpt +++ b/test/EndToEnd/Version11/TestCase/WithBeforeAttribute/test.phpt @@ -22,10 +22,11 @@ Configuration: %s/EndToEnd/Version11/TestCase/WithBeforeAttribute/phpunit.xml ... 3 / 3 (100%) -Detected 2 tests that took longer than expected. +Detected 3 tests that took longer than expected. -1. 0.3%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version11\TestCase\WithBeforeAttribute\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#1 -2. 0.2%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version11\TestCase\WithBeforeAttribute\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#0 +1. 0.4%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version11\TestCase\WithBeforeAttribute\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#1 +2. 0.3%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version11\TestCase\WithBeforeAttribute\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#0 +3. 0.1%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version11\TestCase\WithBeforeAttribute\SleeperTest::testSleeperSleepsLessThanMaximumDurationFromXmlConfiguration Time: %s, Memory: %s diff --git a/test/EndToEnd/Version11/TestCase/WithSetUp/test.phpt b/test/EndToEnd/Version11/TestCase/WithSetUp/test.phpt index b1402423..33cbcc9a 100644 --- a/test/EndToEnd/Version11/TestCase/WithSetUp/test.phpt +++ b/test/EndToEnd/Version11/TestCase/WithSetUp/test.phpt @@ -22,10 +22,11 @@ Configuration: %s/EndToEnd/Version11/TestCase/WithSetUp/phpunit.xml ... 3 / 3 (100%) -Detected 2 tests that took longer than expected. +Detected 3 tests that took longer than expected. -1. 0.3%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version11\TestCase\WithSetUp\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#1 -2. 0.2%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version11\TestCase\WithSetUp\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#0 +1. 0.4%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version11\TestCase\WithSetUp\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#1 +2. 0.3%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version11\TestCase\WithSetUp\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#0 +3. 0.1%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version11\TestCase\WithSetUp\SleeperTest::testSleeperSleepsLessThanMaximumDurationFromXmlConfiguration Time: %s, Memory: %s diff --git a/test/EndToEnd/Version11/TestCase/WithTearDown/test.phpt b/test/EndToEnd/Version11/TestCase/WithTearDown/test.phpt index 9c856192..76d77d9e 100644 --- a/test/EndToEnd/Version11/TestCase/WithTearDown/test.phpt +++ b/test/EndToEnd/Version11/TestCase/WithTearDown/test.phpt @@ -22,10 +22,11 @@ Configuration: %s/EndToEnd/Version11/TestCase/WithTearDown/phpunit.xml ... 3 / 3 (100%) -Detected 2 tests that took longer than expected. +Detected 3 tests that took longer than expected. -1. 0.3%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version11\TestCase\WithTearDown\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#1 -2. 0.2%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version11\TestCase\WithTearDown\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#0 +1. 0.4%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version11\TestCase\WithTearDown\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#1 +2. 0.3%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version11\TestCase\WithTearDown\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWithDataProvider#0 +3. 0.1%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version11\TestCase\WithTearDown\SleeperTest::testSleeperSleepsLessThanMaximumDurationFromXmlConfiguration Time: %s, Memory: %s diff --git a/test/EndToEnd/Version11/TestMethod/WithRunInSeparateProcessAttribute/test.phpt b/test/EndToEnd/Version11/TestMethod/WithRunInSeparateProcessAttribute/test.phpt index 36a1607d..8491c6dd 100644 --- a/test/EndToEnd/Version11/TestMethod/WithRunInSeparateProcessAttribute/test.phpt +++ b/test/EndToEnd/Version11/TestMethod/WithRunInSeparateProcessAttribute/test.phpt @@ -29,10 +29,10 @@ Configuration: %s/EndToEnd/Version11/TestMethod/WithRunInSeparateProcessAttribut Detected 4 tests that took longer than expected. -1. 0.4%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version11\TestMethod\WithRunInSeparateProcessAttribute\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWhenMethodHasRunInSeparateProcessAttribute -2. 0.3%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version11\TestMethod\WithRunInSeparateProcessAttribute\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfiguration -3. 0.1%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version11\TestMethod\WithRunInSeparateProcessAttribute\SleeperTest::testSleeperSleepsShorterThanMaximumDurationFromXmlConfiguration -4. 0.1%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version11\TestMethod\WithRunInSeparateProcessAttribute\SleeperTest::testSleeperSleepsShorterThanMaximumDurationFromXmlConfigurationWhenMethodHasRunInSeparateProcessAttribute +1. 1.3%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version11\TestMethod\WithRunInSeparateProcessAttribute\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfigurationWhenMethodHasRunInSeparateProcessAttribute +2. 1.0%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version11\TestMethod\WithRunInSeparateProcessAttribute\SleeperTest::testSleeperSleepsShorterThanMaximumDurationFromXmlConfigurationWhenMethodHasRunInSeparateProcessAttribute +3. 0.8%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version11\TestMethod\WithRunInSeparateProcessAttribute\SleeperTest::testSleeperSleepsLongerThanMaximumDurationFromXmlConfiguration +4. 0.6%s (0.100) Ergebnis\PHPUnit\SlowTestDetector\Test\EndToEnd\Version11\TestMethod\WithRunInSeparateProcessAttribute\SleeperTest::testSleeperSleepsShorterThanMaximumDurationFromXmlConfiguration Time: %s, Memory: %s