-
Notifications
You must be signed in to change notification settings - Fork 104
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[enhancement] Various enhancements to the results DB feature #3283
Merged
vkarak
merged 15 commits into
reframe-hpc:develop
from
vkarak:feat/results-db-enhancements
Oct 23, 2024
Merged
[enhancement] Various enhancements to the results DB feature #3283
vkarak
merged 15 commits into
reframe-hpc:develop
from
vkarak:feat/results-db-enhancements
Oct 23, 2024
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
vkarak
added
prio: normal
enhancement
reporting
Issues related to reporting and processing the test results
labels
Oct 11, 2024
- Support for computed virtual test attributes - `basename`: the test's name without any parameters - `sysenv`: the formatted system, partition, environment combination - `pdiff`: the performance difference when doing comparisons - Support for completely custom groupings - Support for arbitrary table column selection - Extend `--list-stored-testcases` to show the performance summary of the selected cases - Format parameters when storing a report/session using the parameter's format function - Show A/B absolute values for non-aggregated attributes/columns
vkarak
force-pushed
the
feat/results-db-enhancements
branch
from
October 11, 2024 12:08
b708cc6
to
eafcdeb
Compare
As another improvement, what would you think of making |
teojgo
requested changes
Oct 23, 2024
Co-authored-by: Theofilos Manitaras <manitaras@cscs.ch>
teojgo
approved these changes
Oct 23, 2024
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Labels
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
More specifically, this PR adds the following enhancements:
basename
: the test's name without any parameters (essentially the test class name). This is useful for parameter-based aggregations.sysenv
: the formatted system, partition, environment combinationpdiff
: the performance difference when doing comparisonsCMPSPEC
is extended to get an explicit list of attributes for grouping test cases.CMPSPEC
is extended to get an explicit list of attribute columns to show. As a result the--table-hide-columns
option is removed as now the exact columns of the output can be specified.--list-stored-testcases
to show the performance summary of the selected cases. It uses the sameCMPSPEC
syntax.-E
for testcase filtering.$
). This allows them to be properly filtered with the session filtering expressionspassed to.--session-filter
--session-extras
option can now be specified multiple times.pretty
table format withoutline
and add a newgrid
format. This is to allow nice printing of multiline cells.--session-filter
option and replace it with special syntax in theCMPSPEC
. This allows us to select and compare different sets of sessions.--list-stored-sessions
,--delete-sessions
) are now accepting the extended query syntax (over time period, session uuid or session filter).Docs and unit tests are updated accordingly.