Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Limit concurrency of CI builds #2475

Merged
merged 1 commit into from
Aug 29, 2022
Merged

Limit concurrency of CI builds #2475

merged 1 commit into from
Aug 29, 2022

Conversation

theunrepentantgeek
Copy link
Member

What this PR does / why we need it:

Limits the concurrency of CI builds because the build machines are small and we suspect we are overloading them.

Special notes for your reviewer:

I'm hoping the CI build for this PR will run with the workflow modification included. If it doesn't, we'll need to merge this, and then run some tests.

How does this PR make you feel:
gif

@@ -114,8 +114,8 @@ jobs:
- name: Build docker image & build configuration YAML
run: |
container_id=${{steps.devcontainer.outputs.id}}
docker exec "$container_id" task controller:docker-build-and-save
docker exec "$container_id" task controller:run-kustomize-for-envtest
docker exec "$container_id" task controller:docker-build-and-save --concurrency 1 # limit concurrency because build machines are small
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Wouldn't this hit timeout/take too much time while running the tests in parallel?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If our build machines were highly spec'd, limiting concurrency to just one task at a time would leave processors idle and memory unused. But we know from experience that the build machines are small, just two vCPU's, and so my hypothesis is that running too many tasks at the same time results in them fighting for resources and everything gets slowed down.

@theunrepentantgeek
Copy link
Member Author

Based on some rudimentary testing, I think this makes some improvement.

image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants