Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merge the benchmark fixes and enhancements to main #5437

Merged
merged 10 commits into from
Aug 21, 2023
Merged

Conversation

trexfeathers
Copy link
Contributor

🚀 Pull Request

Description

Draft for now, as needs an extra What's New entry


Consult Iris pull request check list

* More sensible print and run functions.

* Avoid permanent modifications in _subprocess_runner.
* On demand benchmarking.

* Correct gh query.

* Correct assignee spacing.

* What's new entry.
* Don't check out head_ref - benchmark the GH simulated merge commit instead.

* What's New entry.
* Include a warning step for overnight benchmarking.

* Fix for failure warning script.

* Better formatting of warning issue title.

* What's new entry.
* Use shlex.split() for bm_runner commands.

* Minor documentation clarifications.
* Set benchmark runs to error if the subprocess errors.

* Still compare results even from a broken run.

* Still upload reports if overnight run fails.

* What's New entry.
* What's new entry.

* What's New entry.

* Hard-code conda channel into asv_delegated_conda.py .

* Fix some rebase confusion in the What's New.
* Inflate benchmark data to ensure laziness.

* What's New entry.
@trexfeathers trexfeathers added Type: Performance Type: Testing Type: Merge Back Merging a feature branch back to main labels Aug 18, 2023
@codecov
Copy link

codecov bot commented Aug 18, 2023

Codecov Report

Patch and project coverage have no change.

Comparison is base (368c2d8) 89.37% compared to head (5bda4e3) 89.37%.

Additional details and impacted files
@@           Coverage Diff           @@
##             main    #5437   +/-   ##
=======================================
  Coverage   89.37%   89.37%           
=======================================
  Files          89       89           
  Lines       22443    22443           
  Branches     5381     5381           
=======================================
  Hits        20058    20058           
  Misses       1639     1639           
  Partials      746      746           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

* What's new entry.

* Correct user name @ESadek-MO.

* Missing colon.
@trexfeathers trexfeathers marked this pull request as ready for review August 18, 2023 15:01
Copy link
Contributor

@ESadek-MO ESadek-MO left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @trexfeathers! Cool to see this go in!

@ESadek-MO ESadek-MO merged commit ff897eb into main Aug 21, 2023
23 checks passed
@ESadek-MO ESadek-MO deleted the FEATURE_benchmarks branch August 21, 2023 08:46
@trexfeathers
Copy link
Contributor Author

Many thanks @ESadek-MO 🙂

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Type: Merge Back Merging a feature branch back to main Type: Performance Type: Testing
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants