Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

use batch gh-workflow-stats-action with separate table #9722

Merged
merged 1 commit into from
Nov 11, 2024

Conversation

fedordikarev
Copy link
Contributor

We found that exporting GH Workflow Runs in batch is more efficient due to

  • better utilisation of Github API
  • and gh runners usage is rounded to minutes, so even when ad-hoc export is done in 5-10 seconds, we billed for one minute usage

So now we introduce batch exporting, with version v0.2.x of github workflow stats exporter.
How it's expected to work now:

  • every 15 minutes we query for the workflow runs, created in last 2 hours
  • to avoid missing workflows that ran for more than 2 hours, every night (00:25) we will query workflows created in past 24 hours and export them as well
  • should we have query for even longer periods?
  • lets see how it works with current schedule
  • for longer periods like for days or weeks, it may require to adjust logic and concurrency of querying data, so lets for now use simpler version

@fedordikarev fedordikarev requested review from bayandin and a team November 11, 2024 19:11
@fedordikarev fedordikarev enabled auto-merge (squash) November 11, 2024 19:17
Copy link

5346 tests run: 5126 passed, 0 failed, 220 skipped (full report)


Flaky tests (1)

Postgres 17

Code coverage* (full report)

  • functions: 31.7% (7867 of 24806 functions)
  • lines: 49.4% (62258 of 126045 lines)

* collected from Rust tests only


The comment gets automatically updated with the latest test results
69d7273 at 2024-11-11T20:13:30.438Z :recycle:

@fedordikarev fedordikarev merged commit fde16f8 into main Nov 11, 2024
85 checks passed
@fedordikarev fedordikarev deleted the feat/infra_ci_report_workflow_stats_on_schedule branch November 11, 2024 20:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants