Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Comprehensive Test Plan: Divide Existing Cypress Test Suite into Separate Test Runs #19004

Closed
4 tasks
Tracked by #18396 ...
keisterj-oddball opened this issue Aug 20, 2024 · 0 comments · Fixed by #19526
Closed
4 tasks
Tracked by #18396 ...
Assignees
Labels
Automated testing CMS team practice area CMS Team CMS Product team that manages both editor exp and devops Needs refining Issue status

Comments

@keisterj-oddball
Copy link
Collaborator

User Story or Problem Statement

As a member of the CMS Team, I want the ability to run a more focused set of E2E tests at various stages of the CMS deployment pipeline, so that I get faster testing feedback on core functionality of the CMS and improve the speed of our deployment pipeline.

Description or Additional Context

In order to create separate test runs for "Critical Path" and "Regression" tests, all existing cypress tests must be categorized as "Critical" or "Regression".

Steps for Implementation

  1. Discuss existing cypress tests with the sitewide teams to determine priority of tests
  2. Annotate existing cypress tests to be included in the appropriate test run(s)
  3. Determine if any test reporting changes are required for new test runs
  4. Create new workflow(s) for triggering specific test runs
  5. Determine the appropriate placement of respective test runs within the CMS deployment pipeline (implementation can be done in a separate issue)

Acceptance Criteria

  • All cypress tests should be annotated as "Critical" or "Regression"
  • Independent "Critical Path" and "Regression" test runs should be able to be triggered
  • There should be consensus regarding the placement of "Critical Path" and "Regression" test runs within the CMS deployment pipeline
  • Verify test reporting is still in tact with the creation of separate test runs
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Automated testing CMS team practice area CMS Team CMS Product team that manages both editor exp and devops Needs refining Issue status
Projects
None yet
1 participant