Run tests tagged with "smoke-tests" first? #3683
Replies: 3 comments 2 replies
-
|
Yes, that's possible. You need to implement a You might also find this blog useful: https://www.wimdeblauwe.com/blog/2021/02/12/junit-5-test-class-orderer-for-spring-boot/ |
Beta Was this translation helpful? Give feedback.
-
|
@sbrannen That seems only to work as expected if tests are not executed in parallel, right? At least that is how it behaves when I implemented that for myself. We run tests fully in parallel and not sequentially. I hoped that even then it would consider the desired order. |
Beta Was this translation helpful? Give feedback.
-
|
It turns out I had to disable my custom |
Beta Was this translation helpful? Give feedback.
-
|
Thank you, I will try that out. It is because currently our E2E smoke tests cannot be run in parallel when the other tests are running. A quick fix would be to run the smoke test in a separate pipeline stage, but then we would lose having a single test result report, for which we use Allure. Running tests in order of priority (there is an Allure annotation for that) can be useful, not just for our current issue. |
Beta Was this translation helpful? Give feedback.
-
|
Closing in light of #3683 (reply in thread). |
Beta Was this translation helpful? Give feedback.
-
Is it possible to implement a JUnit extension which runs tests which are tagged with "smoke-tests" before all other tests (in a single run)?
Or how can it be done without running first the tests tagged with "smoke-test" and after that running all other tests?
Beta Was this translation helpful? Give feedback.
All reactions