Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cypress Allure report shows a count of failed test cases that is less than the actual count. #223

Open
nthallap opened this issue Dec 1, 2023 · 2 comments
Labels
bug Something isn't working

Comments

@nthallap
Copy link

nthallap commented Dec 1, 2023

Describe the bug
When I run several Cypress test cases(50 test cases) around 20 test cases are failing.
When i check cypress allure reports, It will show total count and failed test count less than actual.

It happens occasionally. Sometimes no reports are generated.

To Reproduce
Steps to reproduce the behavior:

  1. Run Cypess test cases, in that some test should fail

Expected behavior
Total test cases count and failed test cases count in the allure reports should match with terminal output after execution.

Environment (please complete the following information):

  • Cypress version: 12.14.0
  • shelex/cypress-allure-plugin 2.40.0
  • OS: Windows | Linux (centos):

** Developer Tools Console Output **

image

Additional context
In the above scenario total test cases 51, passed 11 failed 35, skipped 2,
but showing as below

image

@nthallap nthallap added the bug Something isn't working label Dec 1, 2023
@nthallap
Copy link
Author

Hi All, any one checked on this issue ?

@Shelex
Copy link
Owner

Shelex commented Jan 30, 2024

Hi @nthallap!

There could be various reasons for that, and most common - when tests have same names accross suites then other test case is calculated as a retry in allure. Would be nice to check allure-results folder to check if recorded information is fine and no tests are missing. Or just try https://github.com/Shelex/cypress-allure-plugin?tab=readme-ov-file#debugging for writer task to check that all information is written to allure-results.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants