-
Notifications
You must be signed in to change notification settings - Fork 292
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Fix test name uniqueness #8015
Merged
Merged
Fix test name uniqueness #8015
+8
−3
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
PerfectSlayer
added
comp: testing
Testing
tag: no release notes
Changes to exclude from release notes
labels
Nov 25, 2024
smola
approved these changes
Nov 25, 2024
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 53 metrics, 10 unstable metrics. Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.44.0-SNAPSHOT~f726f4a835, baseline=1.43.0-SNAPSHOT~f2d21ae588
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.095 s) : 0, 1094926
Total [baseline] (10.483 s) : 0, 10482864
Agent [candidate] (1.087 s) : 0, 1087293
Total [candidate] (10.447 s) : 0, 10447051
section appsec
Agent [baseline] (1.23 s) : 0, 1230298
Total [baseline] (10.767 s) : 0, 10766974
Agent [candidate] (1.223 s) : 0, 1222556
Total [candidate] (10.719 s) : 0, 10718780
section iast
Agent [baseline] (1.218 s) : 0, 1218027
Total [baseline] (11.056 s) : 0, 11055717
Agent [candidate] (1.223 s) : 0, 1223441
Total [candidate] (10.924 s) : 0, 10924124
section profiling
Agent [baseline] (1.314 s) : 0, 1313569
Total [baseline] (10.831 s) : 0, 10831007
Agent [candidate] (1.323 s) : 0, 1322965
Total [candidate] (10.828 s) : 0, 10827893
gantt
title petclinic - break down per module: candidate=1.44.0-SNAPSHOT~f726f4a835, baseline=1.43.0-SNAPSHOT~f2d21ae588
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (698.481 ms) : 0, 698481
BytebuddyAgent [candidate] (692.531 ms) : 0, 692531
GlobalTracer [baseline] (318.991 ms) : 0, 318991
GlobalTracer [candidate] (316.436 ms) : 0, 316436
AppSec [baseline] (55.086 ms) : 0, 55086
AppSec [candidate] (54.839 ms) : 0, 54839
Remote Config [baseline] (701.934 µs) : 0, 702
Remote Config [candidate] (692.161 µs) : 0, 692
Telemetry [baseline] (7.854 ms) : 0, 7854
Telemetry [candidate] (9.153 ms) : 0, 9153
section appsec
BytebuddyAgent [baseline] (715.123 ms) : 0, 715123
BytebuddyAgent [candidate] (710.046 ms) : 0, 710046
GlobalTracer [baseline] (315.501 ms) : 0, 315501
GlobalTracer [candidate] (313.559 ms) : 0, 313559
AppSec [baseline] (166.688 ms) : 0, 166688
AppSec [candidate] (167.035 ms) : 0, 167035
Remote Config [baseline] (655.985 µs) : 0, 656
Remote Config [candidate] (639.248 µs) : 0, 639
Telemetry [baseline] (8.555 ms) : 0, 8555
Telemetry [candidate] (7.8 ms) : 0, 7800
IAST [baseline] (19.994 ms) : 0, 19994
IAST [candidate] (19.638 ms) : 0, 19638
section iast
BytebuddyAgent [baseline] (811.575 ms) : 0, 811575
BytebuddyAgent [candidate] (814.256 ms) : 0, 814256
GlobalTracer [baseline] (305.877 ms) : 0, 305877
GlobalTracer [candidate] (307.336 ms) : 0, 307336
AppSec [baseline] (58.183 ms) : 0, 58183
AppSec [candidate] (57.203 ms) : 0, 57203
Remote Config [baseline] (618.489 µs) : 0, 618
Remote Config [candidate] (620.067 µs) : 0, 620
Telemetry [baseline] (7.507 ms) : 0, 7507
Telemetry [candidate] (7.525 ms) : 0, 7525
IAST [baseline] (20.583 ms) : 0, 20583
IAST [candidate] (22.761 ms) : 0, 22761
section profiling
BytebuddyAgent [baseline] (686.504 ms) : 0, 686504
BytebuddyAgent [candidate] (693.179 ms) : 0, 693179
GlobalTracer [baseline] (432.486 ms) : 0, 432486
GlobalTracer [candidate] (434.424 ms) : 0, 434424
AppSec [baseline] (53.494 ms) : 0, 53494
AppSec [candidate] (53.784 ms) : 0, 53784
Remote Config [baseline] (681.94 µs) : 0, 682
Remote Config [candidate] (672.384 µs) : 0, 672
Telemetry [baseline] (7.759 ms) : 0, 7759
Telemetry [candidate] (7.771 ms) : 0, 7771
ProfilingAgent [baseline] (93.726 ms) : 0, 93726
ProfilingAgent [candidate] (93.833 ms) : 0, 93833
Profiling [baseline] (93.75 ms) : 0, 93750
Profiling [candidate] (93.858 ms) : 0, 93858
Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.44.0-SNAPSHOT~f726f4a835, baseline=1.43.0-SNAPSHOT~f2d21ae588
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.094 s) : 0, 1094297
Total [baseline] (8.683 s) : 0, 8683470
Agent [candidate] (1.091 s) : 0, 1090797
Total [candidate] (8.652 s) : 0, 8651649
section iast
Agent [baseline] (1.217 s) : 0, 1216866
Total [baseline] (9.217 s) : 0, 9216704
Agent [candidate] (1.22 s) : 0, 1220495
Total [candidate] (9.184 s) : 0, 9184377
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.226 s) : 0, 1225637
Total [baseline] (9.173 s) : 0, 9173224
Agent [candidate] (1.22 s) : 0, 1219670
Total [candidate] (9.204 s) : 0, 9203560
section iast_TELEMETRY_OFF
Agent [baseline] (1.216 s) : 0, 1216466
Total [baseline] (9.191 s) : 0, 9190536
Agent [candidate] (1.232 s) : 0, 1231526
Total [candidate] (9.247 s) : 0, 9247276
gantt
title insecure-bank - break down per module: candidate=1.44.0-SNAPSHOT~f726f4a835, baseline=1.43.0-SNAPSHOT~f2d21ae588
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (698.719 ms) : 0, 698719
BytebuddyAgent [candidate] (693.444 ms) : 0, 693444
GlobalTracer [baseline] (317.638 ms) : 0, 317638
GlobalTracer [candidate] (316.86 ms) : 0, 316860
AppSec [baseline] (54.944 ms) : 0, 54944
AppSec [candidate] (54.829 ms) : 0, 54829
Remote Config [baseline] (686.601 µs) : 0, 687
Remote Config [candidate] (701.286 µs) : 0, 701
Telemetry [baseline] (8.469 ms) : 0, 8469
Telemetry [candidate] (11.243 ms) : 0, 11243
section iast
BytebuddyAgent [baseline] (810.572 ms) : 0, 810572
BytebuddyAgent [candidate] (812.708 ms) : 0, 812708
GlobalTracer [baseline] (305.54 ms) : 0, 305540
GlobalTracer [candidate] (306.903 ms) : 0, 306903
AppSec [baseline] (57.246 ms) : 0, 57246
AppSec [candidate] (57.248 ms) : 0, 57248
IAST [baseline] (21.646 ms) : 0, 21646
IAST [candidate] (21.683 ms) : 0, 21683
Remote Config [baseline] (626.585 µs) : 0, 627
Remote Config [candidate] (624.896 µs) : 0, 625
Telemetry [baseline] (7.478 ms) : 0, 7478
Telemetry [candidate] (7.56 ms) : 0, 7560
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (816.389 ms) : 0, 816389
BytebuddyAgent [candidate] (812.259 ms) : 0, 812259
GlobalTracer [baseline] (307.655 ms) : 0, 307655
GlobalTracer [candidate] (306.415 ms) : 0, 306415
AppSec [baseline] (57.047 ms) : 0, 57047
AppSec [candidate] (58.173 ms) : 0, 58173
IAST [baseline] (22.557 ms) : 0, 22557
IAST [candidate] (20.917 ms) : 0, 20917
Remote Config [baseline] (629.437 µs) : 0, 629
Remote Config [candidate] (635.937 µs) : 0, 636
Telemetry [baseline] (7.527 ms) : 0, 7527
Telemetry [candidate] (7.554 ms) : 0, 7554
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (810.224 ms) : 0, 810224
BytebuddyAgent [candidate] (820.353 ms) : 0, 820353
GlobalTracer [baseline] (306.283 ms) : 0, 306283
GlobalTracer [candidate] (309.792 ms) : 0, 309792
AppSec [baseline] (57.267 ms) : 0, 57267
AppSec [candidate] (57.712 ms) : 0, 57712
IAST [baseline] (20.999 ms) : 0, 20999
IAST [candidate] (21.596 ms) : 0, 21596
Remote Config [baseline] (614.825 µs) : 0, 615
Remote Config [candidate] (631.478 µs) : 0, 631
Telemetry [baseline] (7.342 ms) : 0, 7342
Telemetry [candidate] (7.528 ms) : 0, 7528
LoadParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 13 metrics, 15 unstable metrics. Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.44.0-SNAPSHOT~f726f4a835, baseline=1.43.0-SNAPSHOT~f2d21ae588
dateFormat X
axisFormat %s
section baseline
no_agent (1.357 ms) : 1337, 1377
. : milestone, 1357,
appsec (1.738 ms) : 1713, 1763
. : milestone, 1738,
appsec_no_iast (1.755 ms) : 1730, 1780
. : milestone, 1755,
iast (1.501 ms) : 1479, 1523
. : milestone, 1501,
profiling (1.511 ms) : 1487, 1535
. : milestone, 1511,
tracing (1.514 ms) : 1491, 1538
. : milestone, 1514,
section candidate
no_agent (1.36 ms) : 1340, 1380
. : milestone, 1360,
appsec (1.754 ms) : 1729, 1779
. : milestone, 1754,
appsec_no_iast (1.761 ms) : 1736, 1786
. : milestone, 1761,
iast (1.518 ms) : 1496, 1541
. : milestone, 1518,
profiling (1.527 ms) : 1502, 1552
. : milestone, 1527,
tracing (1.511 ms) : 1483, 1538
. : milestone, 1511,
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.44.0-SNAPSHOT~f726f4a835, baseline=1.43.0-SNAPSHOT~f2d21ae588
dateFormat X
axisFormat %s
section baseline
no_agent (375.374 µs) : 356, 395
. : milestone, 375,
iast (494.997 µs) : 473, 517
. : milestone, 495,
iast_FULL (651.848 µs) : 630, 673
. : milestone, 652,
iast_GLOBAL (519.528 µs) : 497, 542
. : milestone, 520,
iast_HARDCODED_SECRET_DISABLED (485.89 µs) : 464, 507
. : milestone, 486,
iast_INACTIVE (456.2 µs) : 436, 477
. : milestone, 456,
iast_TELEMETRY_OFF (481.652 µs) : 460, 503
. : milestone, 482,
tracing (454.402 µs) : 433, 476
. : milestone, 454,
section candidate
no_agent (379.429 µs) : 360, 399
. : milestone, 379,
iast (495.603 µs) : 474, 517
. : milestone, 496,
iast_FULL (657.049 µs) : 635, 679
. : milestone, 657,
iast_GLOBAL (529.154 µs) : 507, 552
. : milestone, 529,
iast_HARDCODED_SECRET_DISABLED (495.607 µs) : 474, 517
. : milestone, 496,
iast_INACTIVE (458.048 µs) : 436, 480
. : milestone, 458,
iast_TELEMETRY_OFF (483.68 µs) : 462, 505
. : milestone, 484,
tracing (449.016 µs) : 428, 470
. : milestone, 449,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics. Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.44.0-SNAPSHOT~f726f4a835, baseline=1.43.0-SNAPSHOT~f2d21ae588
dateFormat X
axisFormat %s
section baseline
no_agent (1.474 ms) : 1463, 1486
. : milestone, 1474,
appsec (2.355 ms) : 2313, 2396
. : milestone, 2355,
iast (2.09 ms) : 2037, 2142
. : milestone, 2090,
iast_GLOBAL (2.136 ms) : 2083, 2189
. : milestone, 2136,
profiling (1.976 ms) : 1933, 2019
. : milestone, 1976,
tracing (1.936 ms) : 1896, 1977
. : milestone, 1936,
section candidate
no_agent (1.47 ms) : 1459, 1482
. : milestone, 1470,
appsec (2.334 ms) : 2293, 2374
. : milestone, 2334,
iast (2.094 ms) : 2042, 2146
. : milestone, 2094,
iast_GLOBAL (2.135 ms) : 2082, 2188
. : milestone, 2135,
profiling (1.958 ms) : 1916, 2001
. : milestone, 1958,
tracing (1.935 ms) : 1895, 1976
. : milestone, 1935,
Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.44.0-SNAPSHOT~f726f4a835, baseline=1.43.0-SNAPSHOT~f2d21ae588
dateFormat X
axisFormat %s
section baseline
no_agent (15.191 s) : 15191000, 15191000
. : milestone, 15191000,
appsec (15.093 s) : 15093000, 15093000
. : milestone, 15093000,
iast (19.043 s) : 19043000, 19043000
. : milestone, 19043000,
iast_GLOBAL (18.182 s) : 18182000, 18182000
. : milestone, 18182000,
profiling (14.91 s) : 14910000, 14910000
. : milestone, 14910000,
tracing (14.82 s) : 14820000, 14820000
. : milestone, 14820000,
section candidate
no_agent (14.934 s) : 14934000, 14934000
. : milestone, 14934000,
appsec (15.017 s) : 15017000, 15017000
. : milestone, 15017000,
iast (18.77 s) : 18770000, 18770000
. : milestone, 18770000,
iast_GLOBAL (17.729 s) : 17729000, 17729000
. : milestone, 17729000,
profiling (15.525 s) : 15525000, 15525000
. : milestone, 15525000,
tracing (15.117 s) : 15117000, 15117000
. : milestone, 15117000,
|
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Labels
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What Does This Do
This PR fixes test name uniqueness.
Motivation
This will help with CI monitoring to keep track of test execution.
Additional Notes
Contributor Checklist
type:
and (comp:
orinst:
) labels in addition to any usefull labelsclose
,fix
or any linking keywords when referencing an issue.Use
solves
instead, and assign the PR milestone to the issueJira ticket: [PROJ-IDENT]