Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update system tests to 8b05076e897fe62206d7704f2e8e650ed83ebd1f #8274

Merged
merged 1 commit into from
Jan 23, 2025
Merged

Update system tests to 8b05076e897fe62206d7704f2e8e650ed83ebd1f #8274

merged 1 commit into from
Jan 23, 2025

Conversation

amarziali
Copy link
Collaborator

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@amarziali amarziali requested a review from a team as a code owner January 23, 2025 12:26
@amarziali amarziali requested a review from smola January 23, 2025 12:26
@github-actions GitHub Actions
Copy link
Contributor

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

  • Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

@amarziali amarziali added comp: testing Testing tag: no release notes Changes to exclude from release notes labels Jan 23, 2025
@pr-commenter
Copy link

pr-commenter bot commented Jan 23, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/update-parametric
git_commit_date 1737634165 1737635114
git_commit_sha 1c3f140 d443107
release_version 1.46.0-SNAPSHOT~1c3f14024a 1.46.0-SNAPSHOT~d443107f74
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1737637504 1737637504
ci_job_id 777542158 777542158
ci_pipeline_id 53788055 53788055
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 5 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.46.0-SNAPSHOT~d443107f74, baseline=1.46.0-SNAPSHOT~1c3f14024a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.064 s) : 0, 1063877
Total [baseline] (10.449 s) : 0, 10449241
Agent [candidate] (1.055 s) : 0, 1054708
Total [candidate] (10.457 s) : 0, 10456582
section appsec
Agent [baseline] (1.185 s) : 0, 1184988
Total [baseline] (10.751 s) : 0, 10751446
Agent [candidate] (1.194 s) : 0, 1193503
Total [candidate] (10.771 s) : 0, 10771035
section iast
Agent [baseline] (1.192 s) : 0, 1191554
Total [baseline] (11.021 s) : 0, 11021100
Agent [candidate] (1.182 s) : 0, 1182137
Total [candidate] (11.006 s) : 0, 11005919
section profiling
Agent [baseline] (1.256 s) : 0, 1256104
Total [baseline] (10.885 s) : 0, 10885420
Agent [candidate] (1.255 s) : 0, 1255023
Total [candidate] (10.853 s) : 0, 10853015
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.064 s -
Agent appsec 1.185 s 121.111 ms (11.4%)
Agent iast 1.192 s 127.677 ms (12.0%)
Agent profiling 1.256 s 192.227 ms (18.1%)
Total tracing 10.449 s -
Total appsec 10.751 s 302.205 ms (2.9%)
Total iast 11.021 s 571.859 ms (5.5%)
Total profiling 10.885 s 436.179 ms (4.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.055 s -
Agent appsec 1.194 s 138.795 ms (13.2%)
Agent iast 1.182 s 127.43 ms (12.1%)
Agent profiling 1.255 s 200.315 ms (19.0%)
Total tracing 10.457 s -
Total appsec 10.771 s 314.452 ms (3.0%)
Total iast 11.006 s 549.337 ms (5.3%)
Total profiling 10.853 s 396.432 ms (3.8%) 
gantt
    title petclinic - break down per module: candidate=1.46.0-SNAPSHOT~d443107f74, baseline=1.46.0-SNAPSHOT~1c3f14024a

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (719.634 ms) : 0, 719634
BytebuddyAgent [candidate] (713.37 ms) : 0, 713370
GlobalTracer [baseline] (257.12 ms) : 0, 257120
GlobalTracer [candidate] (254.88 ms) : 0, 254880
AppSec [baseline] (55.942 ms) : 0, 55942
AppSec [candidate] (56.125 ms) : 0, 56125
Remote Config [baseline] (747.302 µs) : 0, 747
Remote Config [candidate] (740.345 µs) : 0, 740
Telemetry [baseline] (15.436 ms) : 0, 15436
Telemetry [candidate] (14.632 ms) : 0, 14632
section appsec
BytebuddyAgent [baseline] (729.87 ms) : 0, 729870
BytebuddyAgent [candidate] (735.225 ms) : 0, 735225
GlobalTracer [baseline] (251.869 ms) : 0, 251869
GlobalTracer [candidate] (253.618 ms) : 0, 253618
AppSec [baseline] (169.868 ms) : 0, 169868
AppSec [candidate] (170.799 ms) : 0, 170799
Remote Config [baseline] (660.589 µs) : 0, 661
Remote Config [candidate] (656.46 µs) : 0, 656
Telemetry [baseline] (8.127 ms) : 0, 8127
Telemetry [candidate] (8.155 ms) : 0, 8155
IAST [baseline] (19.324 ms) : 0, 19324
IAST [candidate] (19.96 ms) : 0, 19960
section iast
BytebuddyAgent [baseline] (838.263 ms) : 0, 838263
BytebuddyAgent [candidate] (832.016 ms) : 0, 832016
GlobalTracer [baseline] (248.323 ms) : 0, 248323
GlobalTracer [candidate] (246.099 ms) : 0, 246099
AppSec [baseline] (58.654 ms) : 0, 58654
AppSec [candidate] (58.131 ms) : 0, 58131
Remote Config [baseline] (666.712 µs) : 0, 667
Remote Config [candidate] (665.424 µs) : 0, 665
Telemetry [baseline] (8.832 ms) : 0, 8832
Telemetry [candidate] (8.703 ms) : 0, 8703
IAST [baseline] (21.778 ms) : 0, 21778
IAST [candidate] (21.526 ms) : 0, 21526
section profiling
BytebuddyAgent [baseline] (704.284 ms) : 0, 704284
BytebuddyAgent [candidate] (703.799 ms) : 0, 703799
GlobalTracer [baseline] (349.591 ms) : 0, 349591
GlobalTracer [candidate] (350.183 ms) : 0, 350183
AppSec [baseline] (55.336 ms) : 0, 55336
AppSec [candidate] (54.242 ms) : 0, 54242
Remote Config [baseline] (715.749 µs) : 0, 716
Remote Config [candidate] (714.541 µs) : 0, 715
Telemetry [baseline] (8.796 ms) : 0, 8796
Telemetry [candidate] (8.787 ms) : 0, 8787
ProfilingAgent [baseline] (95.465 ms) : 0, 95465
ProfilingAgent [candidate] (95.331 ms) : 0, 95331
Profiling [baseline] (95.491 ms) : 0, 95491
Profiling [candidate] (95.356 ms) : 0, 95356
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.46.0-SNAPSHOT~d443107f74, baseline=1.46.0-SNAPSHOT~1c3f14024a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.071 s) : 0, 1071260
Total [baseline] (8.704 s) : 0, 8703804
Agent [candidate] (1.053 s) : 0, 1052824
Total [candidate] (8.618 s) : 0, 8618343
section iast
Agent [baseline] (1.181 s) : 0, 1181232
Total [baseline] (9.209 s) : 0, 9208812
Agent [candidate] (1.183 s) : 0, 1183327
Total [candidate] (9.255 s) : 0, 9254813
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.198 s) : 0, 1198138
Total [baseline] (9.22 s) : 0, 9220148
Agent [candidate] (1.184 s) : 0, 1184252
Total [candidate] (9.22 s) : 0, 9220132
section iast_TELEMETRY_OFF
Agent [baseline] (1.177 s) : 0, 1177408
Total [baseline] (9.22 s) : 0, 9219613
Agent [candidate] (1.179 s) : 0, 1179323
Total [candidate] (9.178 s) : 0, 9178394
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.071 s -
Agent iast 1.181 s 109.972 ms (10.3%)
Agent iast_HARDCODED_SECRET_DISABLED 1.198 s 126.878 ms (11.8%)
Agent iast_TELEMETRY_OFF 1.177 s 106.149 ms (9.9%)
Total tracing 8.704 s -
Total iast 9.209 s 505.008 ms (5.8%)
Total iast_HARDCODED_SECRET_DISABLED 9.22 s 516.344 ms (5.9%)
Total iast_TELEMETRY_OFF 9.22 s 515.808 ms (5.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.053 s -
Agent iast 1.183 s 130.503 ms (12.4%)
Agent iast_HARDCODED_SECRET_DISABLED 1.184 s 131.428 ms (12.5%)
Agent iast_TELEMETRY_OFF 1.179 s 126.499 ms (12.0%)
Total tracing 8.618 s -
Total iast 9.255 s 636.47 ms (7.4%)
Total iast_HARDCODED_SECRET_DISABLED 9.22 s 601.789 ms (7.0%)
Total iast_TELEMETRY_OFF 9.178 s 560.051 ms (6.5%) 
gantt
    title insecure-bank - break down per module: candidate=1.46.0-SNAPSHOT~d443107f74, baseline=1.46.0-SNAPSHOT~1c3f14024a

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (724.051 ms) : 0, 724051
BytebuddyAgent [candidate] (712.515 ms) : 0, 712515
GlobalTracer [baseline] (258.733 ms) : 0, 258733
GlobalTracer [candidate] (254.402 ms) : 0, 254402
AppSec [baseline] (56.818 ms) : 0, 56818
AppSec [candidate] (55.98 ms) : 0, 55980
Remote Config [baseline] (756.7 µs) : 0, 757
Remote Config [candidate] (721.51 µs) : 0, 722
Telemetry [baseline] (15.717 ms) : 0, 15717
Telemetry [candidate] (14.234 ms) : 0, 14234
section iast
BytebuddyAgent [baseline] (831.204 ms) : 0, 831204
BytebuddyAgent [candidate] (832.497 ms) : 0, 832497
GlobalTracer [baseline] (246.148 ms) : 0, 246148
GlobalTracer [candidate] (246.616 ms) : 0, 246616
AppSec [baseline] (57.921 ms) : 0, 57921
AppSec [candidate] (58.232 ms) : 0, 58232
Remote Config [baseline] (655.047 µs) : 0, 655
Remote Config [candidate] (657.102 µs) : 0, 657
Telemetry [baseline] (8.703 ms) : 0, 8702
Telemetry [candidate] (8.756 ms) : 0, 8756
IAST [baseline] (21.596 ms) : 0, 21596
IAST [candidate] (21.541 ms) : 0, 21541
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (843.438 ms) : 0, 843438
BytebuddyAgent [candidate] (833.311 ms) : 0, 833311
GlobalTracer [baseline] (249.233 ms) : 0, 249233
GlobalTracer [candidate] (246.28 ms) : 0, 246280
AppSec [baseline] (58.666 ms) : 0, 58666
AppSec [candidate] (58.33 ms) : 0, 58330
Remote Config [baseline] (723.879 µs) : 0, 724
Remote Config [candidate] (855.756 µs) : 0, 856
Telemetry [baseline] (8.959 ms) : 0, 8959
Telemetry [candidate] (8.751 ms) : 0, 8751
IAST [baseline] (21.9 ms) : 0, 21900
IAST [candidate] (21.699 ms) : 0, 21699
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (828.249 ms) : 0, 828249
BytebuddyAgent [candidate] (829.878 ms) : 0, 829878
GlobalTracer [baseline] (245.895 ms) : 0, 245895
GlobalTracer [candidate] (246.325 ms) : 0, 246325
AppSec [baseline] (58.002 ms) : 0, 58002
AppSec [candidate] (58.008 ms) : 0, 58008
Remote Config [baseline] (658.307 µs) : 0, 658
Remote Config [candidate] (662.406 µs) : 0, 662
Telemetry [baseline] (8.618 ms) : 0, 8618
Telemetry [candidate] (8.622 ms) : 0, 8622
IAST [baseline] (21.013 ms) : 0, 21013
IAST [candidate] (20.826 ms) : 0, 20826
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-01-23T12:35:03 2025-01-23T12:42:07
git_branch master andrea.marziali/update-parametric
git_commit_date 1737634165 1737635114
git_commit_sha 1c3f140 d443107
release_version 1.46.0-SNAPSHOT~1c3f14024a 1.46.0-SNAPSHOT~d443107f74
start_time 2025-01-23T12:34:50 2025-01-23T12:41:54
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1737636484 1737636484
ci_job_id 777542161 777542161
ci_pipeline_id 53788055 53788055
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 16 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:petclinic:profiling better
[-115.223µs; -62.863µs] or [-7.269%; -3.966%]		 unstable
[-470.223op/s; +698.143op/s] or [-15.870%; +23.562%]		 1.496ms 3076.923op/s 1.585ms 2962.963op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.46.0-SNAPSHOT~d443107f74, baseline=1.46.0-SNAPSHOT~1c3f14024a
    dateFormat X
    axisFormat %s
section baseline
no_agent (377.899 µs) : 357, 399
.   : milestone, 378,
iast (499.229 µs) : 478, 521
.   : milestone, 499,
iast_FULL (738.806 µs) : 717, 761
.   : milestone, 739,
iast_GLOBAL (550.366 µs) : 528, 572
.   : milestone, 550,
iast_HARDCODED_SECRET_DISABLED (499.131 µs) : 478, 521
.   : milestone, 499,
iast_INACTIVE (450.821 µs) : 430, 472
.   : milestone, 451,
iast_TELEMETRY_OFF (494.22 µs) : 472, 516
.   : milestone, 494,
tracing (447.786 µs) : 427, 469
.   : milestone, 448,
section candidate
no_agent (382.494 µs) : 363, 402
.   : milestone, 382,
iast (506.748 µs) : 485, 529
.   : milestone, 507,
iast_FULL (735.987 µs) : 714, 758
.   : milestone, 736,
iast_GLOBAL (549.249 µs) : 527, 571
.   : milestone, 549,
iast_HARDCODED_SECRET_DISABLED (501.113 µs) : 480, 523
.   : milestone, 501,
iast_INACTIVE (458.722 µs) : 437, 480
.   : milestone, 459,
iast_TELEMETRY_OFF (486.663 µs) : 465, 508
.   : milestone, 487,
tracing (441.565 µs) : 421, 462
.   : milestone, 442,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 377.899 µs [356.937 µs, 398.86 µs] -
iast 499.229 µs [477.803 µs, 520.656 µs] 121.33 µs (32.1%)
iast_FULL 738.806 µs [716.64 µs, 760.972 µs] 360.907 µs (95.5%)
iast_GLOBAL 550.366 µs [528.28 µs, 572.453 µs] 172.468 µs (45.6%)
iast_HARDCODED_SECRET_DISABLED 499.131 µs [477.635 µs, 520.628 µs] 121.233 µs (32.1%)
iast_INACTIVE 450.821 µs [429.612 µs, 472.031 µs] 72.923 µs (19.3%)
iast_TELEMETRY_OFF 494.22 µs [472.458 µs, 515.981 µs] 116.321 µs (30.8%)
tracing 447.786 µs [426.897 µs, 468.674 µs] 69.887 µs (18.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 382.494 µs [362.896 µs, 402.092 µs] -
iast 506.748 µs [484.55 µs, 528.946 µs] 124.255 µs (32.5%)
iast_FULL 735.987 µs [714.111 µs, 757.863 µs] 353.494 µs (92.4%)
iast_GLOBAL 549.249 µs [527.436 µs, 571.063 µs] 166.756 µs (43.6%)
iast_HARDCODED_SECRET_DISABLED 501.113 µs [479.512 µs, 522.713 µs] 118.619 µs (31.0%)
iast_INACTIVE 458.722 µs [436.948 µs, 480.497 µs] 76.229 µs (19.9%)
iast_TELEMETRY_OFF 486.663 µs [465.111 µs, 508.214 µs] 104.169 µs (27.2%)
tracing 441.565 µs [421.145 µs, 461.984 µs] 59.071 µs (15.4%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.46.0-SNAPSHOT~d443107f74, baseline=1.46.0-SNAPSHOT~1c3f14024a
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.32 ms) : 1301, 1339
.   : milestone, 1320,
appsec (1.748 ms) : 1724, 1771
.   : milestone, 1748,
appsec_no_iast (1.768 ms) : 1745, 1791
.   : milestone, 1768,
iast (1.507 ms) : 1482, 1532
.   : milestone, 1507,
profiling (1.585 ms) : 1560, 1610
.   : milestone, 1585,
tracing (1.494 ms) : 1470, 1519
.   : milestone, 1494,
section candidate
no_agent (1.348 ms) : 1328, 1367
.   : milestone, 1348,
appsec (1.762 ms) : 1739, 1785
.   : milestone, 1762,
appsec_no_iast (1.752 ms) : 1728, 1777
.   : milestone, 1752,
iast (1.505 ms) : 1480, 1530
.   : milestone, 1505,
profiling (1.496 ms) : 1473, 1519
.   : milestone, 1496,
tracing (1.48 ms) : 1455, 1505
.   : milestone, 1480,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.32 ms [1.301 ms, 1.339 ms] -
appsec 1.748 ms [1.724 ms, 1.771 ms] 427.751 µs (32.4%)
appsec_no_iast 1.768 ms [1.745 ms, 1.791 ms] 447.962 µs (33.9%)
iast 1.507 ms [1.482 ms, 1.532 ms] 186.979 µs (14.2%)
profiling 1.585 ms [1.56 ms, 1.61 ms] 265.211 µs (20.1%)
tracing 1.494 ms [1.47 ms, 1.519 ms] 174.238 µs (13.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.348 ms [1.328 ms, 1.367 ms] -
appsec 1.762 ms [1.739 ms, 1.785 ms] 414.307 µs (30.7%)
appsec_no_iast 1.752 ms [1.728 ms, 1.777 ms] 404.528 µs (30.0%)
iast 1.505 ms [1.48 ms, 1.53 ms] 157.3 µs (11.7%)
profiling 1.496 ms [1.473 ms, 1.519 ms] 148.297 µs (11.0%)
tracing 1.48 ms [1.455 ms, 1.505 ms] 132.653 µs (9.8%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/update-parametric
git_commit_date 1737634165 1737635114
git_commit_sha 1c3f140 d443107
release_version 1.46.0-SNAPSHOT~1c3f14024a 1.46.0-SNAPSHOT~d443107f74
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1737637163 1737637163
ci_job_id 777542163 777542163
ci_pipeline_id 53788055 53788055
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.46.0-SNAPSHOT~d443107f74, baseline=1.46.0-SNAPSHOT~1c3f14024a
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.942 s) : 14942000, 14942000
.   : milestone, 14942000,
appsec (15.195 s) : 15195000, 15195000
.   : milestone, 15195000,
iast (18.982 s) : 18982000, 18982000
.   : milestone, 18982000,
iast_GLOBAL (17.939 s) : 17939000, 17939000
.   : milestone, 17939000,
profiling (15.071 s) : 15071000, 15071000
.   : milestone, 15071000,
tracing (14.824 s) : 14824000, 14824000
.   : milestone, 14824000,
section candidate
no_agent (14.606 s) : 14606000, 14606000
.   : milestone, 14606000,
appsec (15.143 s) : 15143000, 15143000
.   : milestone, 15143000,
iast (19.091 s) : 19091000, 19091000
.   : milestone, 19091000,
iast_GLOBAL (18.027 s) : 18027000, 18027000
.   : milestone, 18027000,
profiling (15.09 s) : 15090000, 15090000
.   : milestone, 15090000,
tracing (15.163 s) : 15163000, 15163000
.   : milestone, 15163000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.942 s [14.942 s, 14.942 s] -
appsec 15.195 s [15.195 s, 15.195 s] 253.0 ms (1.7%)
iast 18.982 s [18.982 s, 18.982 s] 4.04 s (27.0%)
iast_GLOBAL 17.939 s [17.939 s, 17.939 s] 2.997 s (20.1%)
profiling 15.071 s [15.071 s, 15.071 s] 129.0 ms (0.9%)
tracing 14.824 s [14.824 s, 14.824 s] -118.0 ms (-0.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.606 s [14.606 s, 14.606 s] -
appsec 15.143 s [15.143 s, 15.143 s] 537.0 ms (3.7%)
iast 19.091 s [19.091 s, 19.091 s] 4.485 s (30.7%)
iast_GLOBAL 18.027 s [18.027 s, 18.027 s] 3.421 s (23.4%)
profiling 15.09 s [15.09 s, 15.09 s] 484.0 ms (3.3%)
tracing 15.163 s [15.163 s, 15.163 s] 557.0 ms (3.8%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.46.0-SNAPSHOT~d443107f74, baseline=1.46.0-SNAPSHOT~1c3f14024a
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.464 ms) : 1453, 1476
.   : milestone, 1464,
appsec (2.363 ms) : 2320, 2405
.   : milestone, 2363,
iast (2.11 ms) : 2056, 2164
.   : milestone, 2110,
iast_GLOBAL (2.146 ms) : 2091, 2201
.   : milestone, 2146,
profiling (1.984 ms) : 1939, 2028
.   : milestone, 1984,
tracing (1.931 ms) : 1889, 1972
.   : milestone, 1931,
section candidate
no_agent (1.468 ms) : 1457, 1480
.   : milestone, 1468,
appsec (2.351 ms) : 2309, 2394
.   : milestone, 2351,
iast (2.091 ms) : 2037, 2145
.   : milestone, 2091,
iast_GLOBAL (2.143 ms) : 2089, 2198
.   : milestone, 2143,
profiling (1.976 ms) : 1932, 2021
.   : milestone, 1976,
tracing (1.938 ms) : 1897, 1980
.   : milestone, 1938,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.464 ms [1.453 ms, 1.476 ms] -
appsec 2.363 ms [2.32 ms, 2.405 ms] 898.458 µs (61.4%)
iast 2.11 ms [2.056 ms, 2.164 ms] 645.781 µs (44.1%)
iast_GLOBAL 2.146 ms [2.091 ms, 2.201 ms] 682.101 µs (46.6%)
profiling 1.984 ms [1.939 ms, 2.028 ms] 519.44 µs (35.5%)
tracing 1.931 ms [1.889 ms, 1.972 ms] 466.622 µs (31.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.468 ms [1.457 ms, 1.48 ms] -
appsec 2.351 ms [2.309 ms, 2.394 ms] 882.929 µs (60.1%)
iast 2.091 ms [2.037 ms, 2.145 ms] 622.648 µs (42.4%)
iast_GLOBAL 2.143 ms [2.089 ms, 2.198 ms] 674.902 µs (46.0%)
profiling 1.976 ms [1.932 ms, 2.021 ms] 507.74 µs (34.6%)
tracing 1.938 ms [1.897 ms, 1.98 ms] 470.118 µs (32.0%)

@amarziali amarziali enabled auto-merge (squash) January 23, 2025 13:09
@amarziali amarziali merged commit ac29d6c into master Jan 23, 2025
176 of 178 checks passed
@amarziali amarziali deleted the andrea.marziali/update-parametric branch January 23, 2025 13:27
@github-actions github-actions bot added this to the 1.46.0 milestone Jan 23, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@smola smola smola approved these changes

Assignees
No one assigned
Labels
comp: testing Testing tag: no release notes Changes to exclude from release notes
Projects
None yet
Milestone
1.46.0
Development

Successfully merging this pull request may close these issues.
2 participants
@amarziali @smola