Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[gui-tests] abort testcase execution on first failure #11868

Merged
merged 1 commit into from
Sep 11, 2024
Merged

Conversation

saw-jan
Copy link
Member

@saw-jan saw-jan commented Sep 10, 2024

  • Allow abort on failure for Squish tests in PRs (using --abortOnFail arg) - skips the next testcases if current fails
  • With full-ci in the PR title, the above behavior is disabled

The --abortOnFail option is available only when using --testsuite option but does not work with --testcase.

--abortOnFail
If the --abortOnFail option is specified, squishrunner will terminate the suite execution as soon as a failed test case is detected.

This means that if we have test cases 1, 2, 3 and 4, and test case no.2 failed then test cases 3 and 4 will not run. Also if the fail was in the first scenario of test case no.2, other scenarios of test case no.2 still continue to run.

Fixes: #10315

@saw-jan saw-jan marked this pull request as ready for review September 10, 2024 08:51
@saw-jan saw-jan changed the title [gui-tests] abort test execution on first failure [gui-tests] abort testcase execution on first failure Sep 10, 2024
@saw-jan saw-jan merged commit d2eeeb3 into master Sep 11, 2024
6 checks passed
@saw-jan saw-jan deleted the tests/fail-early branch September 11, 2024 11:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[QA] Allow early fail in drone CI
2 participants