You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Right now test_summary.csv is only updated when --update flag is set, but we don't verify that it is correct in the mode without an update.
I think at the very least, we should check in CI that this file is up-to-date.
The text was updated successfully, but these errors were encountered:
Also, I think it would be great to have some github bot(?) which monitor PR changes and alaram us in PR discussion (simply posting message there) if any of state.csv is degradating in this PR. Maybe somebody knows some tools for it?
Also, I think it would be great to have some github bot(?) which monitor PR changes and alaram us in PR discussion (simply posting message there) if any of state.csv is degradating in this PR. Maybe somebody knows some tools for it?
I think that would be great - there is a GitHub Action that can create comments in PRs by the bot. For example, we can post testing and benchmarking results after each new commit in the PR.
Right now
test_summary.csv
is only updated when--update
flag is set, but we don't verify that it is correct in the mode without an update.I think at the very least, we should check in CI that this file is up-to-date.
The text was updated successfully, but these errors were encountered: