Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create proposal how to automate testing Hub manifests #44

Open
pkosiec opened this issue Nov 15, 2021 · 0 comments
Open

Create proposal how to automate testing Hub manifests #44

pkosiec opened this issue Nov 15, 2021 · 0 comments
Labels
area/ci Relates to CI area/hub-manifests Relates to Hub manifests enhancement New feature or request

Comments

@pkosiec
Copy link
Member

pkosiec commented Nov 15, 2021

Description

Write proposal about our approach for automated Hub manifests testing.

  • We want to test all Implementations inside a given GitHub repository
  • In an automated way
  • As GitHub Actions pipeline (but to verify whether we don't need to run such tests on external cluster, because of resource limits for GH Actions Runner)
  • Should we support testing day-two operations?
  • Cleanup: currently external cluster delete?
  • Answer the question: Do we need to write some small testing framework? Or can we use something existing from OS community?
  • Result: a document on capactio/capact repository summarizing the possibilities with a short comparison
  • Nice to have: Prepare PoC to showcase the preferred idea

Reason

Currently, to test the manifests inside the hub-manifests repository, we need to manually run Actions. Our end goal is to have it automated, so that all Implementations are executed to check whether they work properly.

Use cases

  • As a System Administrator, I want to make sure that the connected Public Hub contains valid, runnable manifests.
  • As Capact Developer, I want to make sure any contribution to the hub-manifests repository is automatically validated on CI without a need to run Actions manually.

Additional links

@pkosiec pkosiec added enhancement New feature or request area/hub-manifests Relates to Hub manifests area/ci Relates to CI labels Nov 15, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/ci Relates to CI area/hub-manifests Relates to Hub manifests enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant