Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Visual tests #2534

Merged
merged 62 commits into from
Apr 2, 2024
Merged

Visual tests #2534

merged 62 commits into from
Apr 2, 2024

Conversation

karl-cardenas-coding
Copy link
Contributor

@karl-cardenas-coding karl-cardenas-coding commented Mar 31, 2024

Describe the Change

This PR introduces visual regression testing capabilities to the documentation site.

Changed Pages

💻 Preview URL for Page

Jira Tickets

🎫 Jira Ticket

Backports

Can this PR be backported?

  • Yes. Remember to add the relevant backport labels to your PR.
  • No. Please leave a short comment below about why this PR cannot be backported.

Copy link
Contributor

github-actions bot commented Apr 2, 2024

🤖 Starting the visual tests. This will take approximately an hour.

@karl-cardenas-coding karl-cardenas-coding enabled auto-merge (squash) April 2, 2024 19:17
@karl-cardenas-coding
Copy link
Contributor Author

Visual Tests canceled for this last commit

Copy link
Contributor

@addetz addetz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just some minor questions but happy for this to 🚢

defaults:
run:
shell: bash
if: ${{ !github.event.pull_request.draft && github.actor != 'dependabot[bot]' && github.actor != 'dependabot-preview[bot]' || contains(github.event.pull_request.labels.*.name, 'visual-tests') }}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Out of scope on this one, but if the main PR is marked with visual-tests surely the backports should be too? I wonder if we should change the backport logic to apply this label to backports too.

path: build
attempt_delay: 60000 # 1 minute

- name: Download Reference Screenshots
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we add some kind of warning if the reference shots are not found in the case they've expired? Would stop a mini heart-attack if everything fails lol

defaults:
run:
shell: bash
if: ${{ !github.event.pull_request.draft && github.actor != 'dependabot[bot]' && github.actor != 'dependabot-preview[bot]' || contains(github.event.pull_request.labels.*.name, 'visual-tests') }}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Perhaps I missed this but where do you detect if changes are made to the src/** or package.json files? This was mentioned in the confluence page

@karl-cardenas-coding karl-cardenas-coding merged commit 0670689 into master Apr 2, 2024
11 of 15 checks passed
@karl-cardenas-coding karl-cardenas-coding deleted the visual-tests branch April 2, 2024 20:06
@karl-cardenas-coding karl-cardenas-coding added backport-version-4-0 Backport change to version 4.0 auto-backport Enable backport backport-version-3-4 Backport change to version 3.4 backport-version-4-1 Backport change to version 4.1 backport-version-4-2 Backport change to version 4.2 labels Apr 2, 2024
vault-token-factory-spectrocloud bot pushed a commit that referenced this pull request Apr 2, 2024
* ci: testing visual comp

* ci: more test

* test: changes

* chore: update CI

* chore: fix npm

* save

* chore: working locally

* chore: working logic

* chore: save

* chore: testing CI

* ci: test ci

* ci: more test

* ci: more ci tests

* ci: test

* chore: updated test

* chore: test

* more tests

* ci: test

* ci: change folder structure

* chore: fixed ci

* chore: reduce test feedback

* chore: more test

* ci: path change

* ci: more test

* ci: update tar config

* ci: retrest

* chore: test

* chore: test

* ci: more test

* chore: more test

* save

* ci: different workflow

* chore: fixed logic

* chore: more tests

* core: ready for PR test

* ci: added missing steps

* ci: screenshot logic

* ci: trigger

* ci: more logic

* ci: fix test path

* test: new logic

* ci: fix download path

* chore: ready

* save

* ci: more tests

* ci: fix screenshots

* ci: more changes

* chore: more tests

* ci: more tests

* chore: restart

* chore: update

* ci: removed Appzi from builds

* chore: save

* ci: new test

* save

* ci: updated artifacts logic

* chore: verify self-hosted runner

* chore: ready for merge

(cherry picked from commit 0670689)
vault-token-factory-spectrocloud bot pushed a commit that referenced this pull request Apr 2, 2024
* ci: testing visual comp

* ci: more test

* test: changes

* chore: update CI

* chore: fix npm

* save

* chore: working locally

* chore: working logic

* chore: save

* chore: testing CI

* ci: test ci

* ci: more test

* ci: more ci tests

* ci: test

* chore: updated test

* chore: test

* more tests

* ci: test

* ci: change folder structure

* chore: fixed ci

* chore: reduce test feedback

* chore: more test

* ci: path change

* ci: more test

* ci: update tar config

* ci: retrest

* chore: test

* chore: test

* ci: more test

* chore: more test

* save

* ci: different workflow

* chore: fixed logic

* chore: more tests

* core: ready for PR test

* ci: added missing steps

* ci: screenshot logic

* ci: trigger

* ci: more logic

* ci: fix test path

* test: new logic

* ci: fix download path

* chore: ready

* save

* ci: more tests

* ci: fix screenshots

* ci: more changes

* chore: more tests

* ci: more tests

* chore: restart

* chore: update

* ci: removed Appzi from builds

* chore: save

* ci: new test

* save

* ci: updated artifacts logic

* chore: verify self-hosted runner

* chore: ready for merge

(cherry picked from commit 0670689)
vault-token-factory-spectrocloud bot pushed a commit that referenced this pull request Apr 2, 2024
* ci: testing visual comp

* ci: more test

* test: changes

* chore: update CI

* chore: fix npm

* save

* chore: working locally

* chore: working logic

* chore: save

* chore: testing CI

* ci: test ci

* ci: more test

* ci: more ci tests

* ci: test

* chore: updated test

* chore: test

* more tests

* ci: test

* ci: change folder structure

* chore: fixed ci

* chore: reduce test feedback

* chore: more test

* ci: path change

* ci: more test

* ci: update tar config

* ci: retrest

* chore: test

* chore: test

* ci: more test

* chore: more test

* save

* ci: different workflow

* chore: fixed logic

* chore: more tests

* core: ready for PR test

* ci: added missing steps

* ci: screenshot logic

* ci: trigger

* ci: more logic

* ci: fix test path

* test: new logic

* ci: fix download path

* chore: ready

* save

* ci: more tests

* ci: fix screenshots

* ci: more changes

* chore: more tests

* ci: more tests

* chore: restart

* chore: update

* ci: removed Appzi from builds

* chore: save

* ci: new test

* save

* ci: updated artifacts logic

* chore: verify self-hosted runner

* chore: ready for merge

(cherry picked from commit 0670689)
@vault-token-factory-spectrocloud
Copy link
Contributor

💔 Some backports could not be created

Status Branch Result
version-4-0
version-3-4 Backport failed because of merge conflicts

You might need to backport the following PRs to version-3-4:
- docs: Image signature final (#1909) DOC-961
- chore: released docs versioning
version-4-1
version-4-2

Note: Successful backport PRs will be merged automatically after passing CI.

Manual backport

To create the backport manually run:

backport --pr 2534

Questions ?

Please refer to the Backport tool documentation and see the Github Action logs for details

vault-token-factory-spectrocloud bot added a commit that referenced this pull request Apr 2, 2024
* ci: testing visual comp

* ci: more test

* test: changes

* chore: update CI

* chore: fix npm

* save

* chore: working locally

* chore: working logic

* chore: save

* chore: testing CI

* ci: test ci

* ci: more test

* ci: more ci tests

* ci: test

* chore: updated test

* chore: test

* more tests

* ci: test

* ci: change folder structure

* chore: fixed ci

* chore: reduce test feedback

* chore: more test

* ci: path change

* ci: more test

* ci: update tar config

* ci: retrest

* chore: test

* chore: test

* ci: more test

* chore: more test

* save

* ci: different workflow

* chore: fixed logic

* chore: more tests

* core: ready for PR test

* ci: added missing steps

* ci: screenshot logic

* ci: trigger

* ci: more logic

* ci: fix test path

* test: new logic

* ci: fix download path

* chore: ready

* save

* ci: more tests

* ci: fix screenshots

* ci: more changes

* chore: more tests

* ci: more tests

* chore: restart

* chore: update

* ci: removed Appzi from builds

* chore: save

* ci: new test

* save

* ci: updated artifacts logic

* chore: verify self-hosted runner

* chore: ready for merge

(cherry picked from commit 0670689)

Co-authored-by: Karl Cardenas <karl@spectrocloud.com>
vault-token-factory-spectrocloud bot added a commit that referenced this pull request Apr 2, 2024
* ci: testing visual comp

* ci: more test

* test: changes

* chore: update CI

* chore: fix npm

* save

* chore: working locally

* chore: working logic

* chore: save

* chore: testing CI

* ci: test ci

* ci: more test

* ci: more ci tests

* ci: test

* chore: updated test

* chore: test

* more tests

* ci: test

* ci: change folder structure

* chore: fixed ci

* chore: reduce test feedback

* chore: more test

* ci: path change

* ci: more test

* ci: update tar config

* ci: retrest

* chore: test

* chore: test

* ci: more test

* chore: more test

* save

* ci: different workflow

* chore: fixed logic

* chore: more tests

* core: ready for PR test

* ci: added missing steps

* ci: screenshot logic

* ci: trigger

* ci: more logic

* ci: fix test path

* test: new logic

* ci: fix download path

* chore: ready

* save

* ci: more tests

* ci: fix screenshots

* ci: more changes

* chore: more tests

* ci: more tests

* chore: restart

* chore: update

* ci: removed Appzi from builds

* chore: save

* ci: new test

* save

* ci: updated artifacts logic

* chore: verify self-hosted runner

* chore: ready for merge

(cherry picked from commit 0670689)

Co-authored-by: Karl Cardenas <karl@spectrocloud.com>
vault-token-factory-spectrocloud bot added a commit that referenced this pull request Apr 2, 2024
* ci: testing visual comp

* ci: more test

* test: changes

* chore: update CI

* chore: fix npm

* save

* chore: working locally

* chore: working logic

* chore: save

* chore: testing CI

* ci: test ci

* ci: more test

* ci: more ci tests

* ci: test

* chore: updated test

* chore: test

* more tests

* ci: test

* ci: change folder structure

* chore: fixed ci

* chore: reduce test feedback

* chore: more test

* ci: path change

* ci: more test

* ci: update tar config

* ci: retrest

* chore: test

* chore: test

* ci: more test

* chore: more test

* save

* ci: different workflow

* chore: fixed logic

* chore: more tests

* core: ready for PR test

* ci: added missing steps

* ci: screenshot logic

* ci: trigger

* ci: more logic

* ci: fix test path

* test: new logic

* ci: fix download path

* chore: ready

* save

* ci: more tests

* ci: fix screenshots

* ci: more changes

* chore: more tests

* ci: more tests

* chore: restart

* chore: update

* ci: removed Appzi from builds

* chore: save

* ci: new test

* save

* ci: updated artifacts logic

* chore: verify self-hosted runner

* chore: ready for merge

(cherry picked from commit 0670689)

Co-authored-by: Karl Cardenas <karl@spectrocloud.com>
@vault-token-factory-spectrocloud
Copy link
Contributor

🎉 This PR is included in version 4.2.1 🎉

The release is available on GitHub release

Your semantic-release bot 📦🚀

@vault-token-factory-spectrocloud
Copy link
Contributor

🎉 This PR is included in version 4.2.1 🎉

The release is available on GitHub release

Your semantic-release bot 📦🚀

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
auto-backport Enable backport backport-version-3-4 Backport change to version 3.4 backport-version-4-0 Backport change to version 4.0 backport-version-4-1 Backport change to version 4.1 backport-version-4-2 Backport change to version 4.2 released visual-tests Trigger the visual tests workflow
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants