Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Integrate energy measurements #1863

Merged
merged 33 commits into from
Nov 22, 2024
Merged

Integrate energy measurements #1863

merged 33 commits into from
Nov 22, 2024

Conversation

Zeitsperre
Copy link
Collaborator

@Zeitsperre Zeitsperre commented Aug 1, 2024

Pull Request Checklist:

  • This PR addresses an already opened issue (for bug fixes / features)
    • This PR fixes #xyz
  • Tests for the changes have been added (for bug fixes / features)
    • (If applicable) Documentation has been added / updated (for bug fixes / features)
  • CHANGELOG.rst has been updated (with summary of main changes)
    • Link to issue (:issue:number) and pull request (:pull:number) has been added

What kind of change does this PR introduce?

  • Adds an Action for estimating the energy usage and carbon emissions of our CI events
  • Addresses a small but rare pytest teardown race condition

Does this PR introduce a breaking change?

No.

Other information:

https://github.com/green-coding-solutions/eco-ci-energy-estimation

@github-actions github-actions bot added the CI Automation and Contiunous Integration label Aug 1, 2024
Copy link

github-actions bot commented Aug 1, 2024

Note

It appears that this Pull Request modifies the main.yml workflow.

On inspection, the XCLIM_TESTDATA_BRANCH environment variable is set to the most recent tag (v2024.8.23).

No further action is required.

@coveralls
Copy link

coveralls commented Aug 1, 2024

Coverage Status

coverage: 89.262%. remained the same
when pulling 6a02078 on energy-usage
into 94530cd on main.

@Zeitsperre Zeitsperre added the approved Approved for additional tests label Aug 1, 2024
@Zeitsperre Zeitsperre self-assigned this Aug 5, 2024
@Ouranosinc Ouranosinc deleted a comment from github-actions bot Aug 6, 2024
@Zeitsperre Zeitsperre changed the title WIP - integrate energy measurements Integrate energy measurements Nov 15, 2024
@Zeitsperre Zeitsperre requested review from aulemahal, huard and a team and removed request for huard and aulemahal November 15, 2024 19:52
@Zeitsperre Zeitsperre marked this pull request as ready for review November 15, 2024 19:53
Copy link

Eco-CI Output:

Label 🖥 avg. CPU utilization [%] 🔋 Total Energy [Joules] 🔌 avg. Power [Watts] Duration [Seconds]
Total Run (incl. overhead) 15.815 3.52529 1.48 2.39
Finish Run 6.88 3.52529 2.00 1.76

🌳 CO2 Data:
City: Chicago, Lat: 41.8874, Lon: -87.6318
IP: 20.88.15.112
CO₂ from energy is: 0.001399425 g
CO₂ from manufacturing (embodied carbon) is: 0.000681900 g
Carbon Intensity for this location: 397 gCO₂eq/kWh
SCI: 0.002081 gCO₂eq / pipeline run emitted

@github-actions github-actions bot added the docs Improvements to documenation label Nov 15, 2024
Copy link
Collaborator

@aulemahal aulemahal left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks! Looking forward in seeing this new indicator evolve.

There's something quite frustrating in that we live and work in one of the less CO2-intensive grid and, yet, this CI sometimes runs in like Chicago which has a 10x more polluting electricity...

@Zeitsperre
Copy link
Collaborator Author

There's something quite frustrating in that we live and work in one of the less CO2-intensive grid and, yet, this CI sometimes runs in like Chicago which has a 10x more polluting electricity...

I was mentioning this to @tlogan2000, that this might help justify looking into having our own dedicate GitHub (or GitLab?) test runners. If the upkeep costs are minimal, I imagine this would really reduce our footprint.

@Zeitsperre Zeitsperre merged commit 4f00c08 into main Nov 22, 2024
23 checks passed
@Zeitsperre Zeitsperre deleted the energy-usage branch November 22, 2024 17:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Approved for additional tests CI Automation and Contiunous Integration docs Improvements to documenation
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants