Skip to content
This repository has been archived by the owner on Sep 17, 2024. It is now read-only.

CI Snapshots is not finding pull request objects because of the huge amount of objects #503

Closed
mdelapenya opened this issue Dec 1, 2020 · 1 comment · Fixed by #504
Closed

CI Snapshots is not finding pull request objects because of the huge amount of objects #503

mdelapenya opened this issue Dec 1, 2020 · 1 comment · Fixed by #504
Labels
bug Something isn't working

Comments

@mdelapenya
Copy link
Contributor

With the addition of commits namespace in the beats-ci GCP bucket, we have thousands of objects and pages, so iterating through the list with current approach, based on GCP's API calls with pagination and pageToken, takes more time than expected:

https://beats-ci.elastic.co/blue/organizations/jenkins/e2e-tests%2Fe2e-testing-mbp/detail/master/776/pipeline/186
Screenshot 2020-12-01 at 21 25 39
@mdelapenya mdelapenya added the bug Something isn't working label Dec 1, 2020
@mdelapenya
Copy link
Contributor Author

Besides that, the default max timeout is 1m, which is super low for the amount of entries.

@mdelapenya mdelapenya mentioned this issue Dec 1, 2020
Merged
10 tasks
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

fix: enhance GCP queries for PRs mdelapenya/e2e-testing
1 participant
@mdelapenya