Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use older 2.x Surefire/Failsafe test runner plugins #503

Merged
merged 1 commit into from
Jun 15, 2021

Conversation

andrewazores
Copy link
Member

3.x preview releases are not correctly running JUnit 5 parameterized tests in all scenarios

This PR is expected to fail CI checks, since it exposes two manually-discovered unit test failures which are currently silently lost with the Surefire/JUnit configuration in use. @hareetd has a correction for those two test cases.

Fixes #502

@andrewazores andrewazores requested a review from hareetd June 7, 2021 20:28
hareetd
hareetd previously approved these changes Jun 8, 2021
Copy link
Contributor

@hareetd hareetd left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good! I'm currently working on fixing the test cases; one of the two worked with a simple removal of the null test cases as previously discussed but the other revealed more complicated errors.

3.x  preview releases are not correctly running JUnit 5 parameterized tests in all scenarios
@andrewazores
Copy link
Member Author

Cleanly rebased on top of @hareetd 's fix for the hidden failures. This should now run and pass all unit tests.

@andrewazores
Copy link
Member Author

Before @hareetd 's last PR in #512 we have 639 tests run/passed. With that PR it becomes 664 run/passed, which is continued with this PR.

@andrewazores andrewazores merged commit 0b9ef87 into cryostatio:main Jun 15, 2021
@andrewazores andrewazores deleted the unit-test-not-run branch June 15, 2021 18:33
andrewazores added a commit to andrewazores/cryostat that referenced this pull request Jun 23, 2021
3.x  preview releases are not correctly running JUnit 5 parameterized tests in all scenarios
andrewazores added a commit that referenced this pull request Jun 23, 2021
* Fix previously hidden unit test failures (#512)

* Remove null test cases and change incorrect Matcher functionality

* Fix incorrect class mocking which causes tests to pass for the wrong reason

* Maintain consistency between tests by allowing use of the same recording name

* Use older 2.x Surefire/Failsafe test runner plugins (#503)

3.x  preview releases are not correctly running JUnit 5 parameterized tests in all scenarios

Co-authored-by: Hareet Dhillon <hareet.dhillon@gmail.com>
andrewazores added a commit to andrewazores/cryostat that referenced this pull request Jun 24, 2021
3.x  preview releases are not correctly running JUnit 5 parameterized tests in all scenarios
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Some unit test failures are unreported, or tests do not run
2 participants