Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Integration tests timing out during Github Actions workflow runs #638

Closed
grahamalama opened this issue Apr 17, 2023 · 3 comments · Fixed by #639
Closed

Integration tests timing out during Github Actions workflow runs #638

grahamalama opened this issue Apr 17, 2023 · 3 comments · Fixed by #639
Assignees
@grahamalama
Labels
bug Something isn't working

Comments

@grahamalama
Copy link
Contributor

It seems like the integration tests are consistently taking longer than 5 minutes, which cancels the job.

e.g. https://github.com/mozilla-it/ctms-api/actions/runs/4669059816?pr=622

image

The job running on runner GitHub Actions 2 has exceeded the maximum execution time of 5 minutes.
The operation was canceled.
@grahamalama grahamalama added the bug Something isn't working label Apr 17, 2023
@grahamalama
Copy link
Contributor Author

grahamalama commented Apr 17, 2023 •
edited
Loading

Possible mitigations could be:

  • setting up Docker layer caching
  • increasing the timeout-minutes for the job

@grahamalama grahamalama linked a pull request Apr 17, 2023 that will close this issue
Bump integration test timeout-minutes from 5 to 10 #639
Merged
@grahamalama
Copy link
Contributor Author

Didn't see that this was on purpose before I created this ticket 😅.

Opened #639 to unblock PRs, but it could still be worth exploring Docker layer caching in the future

@grahamalama
Copy link
Contributor Author

Well, apparently bumping the time limit wasn't enough -- I canceled the first workflow run triggered by this PR.

Perhaps we should tweak our backoff strategy and/or do some logging to inspect failures?

@grahamalama grahamalama mentioned this issue Apr 19, 2023
Merged
@grahamalama grahamalama self-assigned this Apr 19, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@grahamalama grahamalama

Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Bump integration test timeout-minutes from 5 to 10 mozilla-it/ctms-api
1 participant
@grahamalama