Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Automated testing #352

Merged
merged 5 commits into from
Mar 28, 2024
Merged

Automated testing #352

merged 5 commits into from
Mar 28, 2024

Conversation

kwk
Copy link
Collaborator

@kwk kwk commented Mar 22, 2024

This is an early attempt to solve what we've discussed in the chat.

  1. Once we find a chroot that has all succeeded builds we should run the tests on testing-farm for that chroot. Before starting the tests we should add the label in_testing/fedora-rawhide-x86_64 (could be any other chroot) to the issue. The CI job runs on a schedule and this signals the next run that even though a chroot only contains succeeded builds, we should not trigger tests but keep calm instead.
  2. Once the testing farm results are in, we remove the in_testing/fedora-rawhide-x86_64 label and add tested_on/fedora-rawhide-x86_64 or failed_on/fedora-rawhide-x86_64 to the issue. This will also be interpreted by the CI to not kick of any more tests.
  3. Once we have only tested_on/fedora-rawhide-x86_64 respectively for all chroots, we can consider this build tested and worth promoting.

TODOs

  • Create in_testing/<chroot> labels
  • Create tested_on/<chroot> labels
  • Create failed_on/<chroot> labels
  • Don't start testing if in progress, or already tested (result is irrelevant)
  • Kick off testing on testing-farm
  • Kick off promotion

@kwk kwk self-assigned this Mar 22, 2024
@kwk kwk marked this pull request as ready for review March 28, 2024 22:11
@kwk kwk merged commit 17ee024 into main Mar 28, 2024
5 checks passed
@kwk kwk deleted the automated-testing branch March 28, 2024 22:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant