Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Filter out Errors for Exception Debugging #6997

Merged
merged 1 commit into from
May 13, 2024
Merged

Filter out Errors for Exception Debugging #6997

merged 1 commit into from
May 13, 2024

Conversation

jpbempel
Copy link
Member

@jpbempel jpbempel commented May 7, 2024 •
edited by jira bot
Loading

What Does This Do

Do not process errors for exception Debugging

Motivation

Additional Notes

Jira ticket: DEBUG-2068

@jpbempel
Filter out Errors for Exception Debugging
da32d18 
Do not process errors for exception Debugging
@jpbempel jpbempel added the comp: debugger Dynamic Instrumentation label May 7, 2024
@jpbempel jpbempel requested a review from a team as a code owner May 7, 2024 12:38
@jpbempel jpbempel requested review from shatzi and removed request for a team May 7, 2024 12:38
@pr-commenter
Copy link

pr-commenter bot commented May 7, 2024

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/filter-out-errors
git_commit_date 1715083491 1715085441
git_commit_sha 23683a0 da32d18
release_version 1.34.0-SNAPSHOT~23683a0e6f 1.34.0-SNAPSHOT~da32d188e5
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1715087917 1715087917
ci_job_id 506114747 506114747
ci_pipeline_id 33757535 33757535
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 50 metrics, 13 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.34.0-SNAPSHOT~da32d188e5, baseline=1.34.0-SNAPSHOT~23683a0e6f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.076 s) : 0, 1076240
Total [baseline] (10.426 s) : 0, 10426335
Agent [candidate] (1.077 s) : 0, 1077287
Total [candidate] (10.356 s) : 0, 10356016
section appsec
Agent [baseline] (1.198 s) : 0, 1198027
Total [baseline] (10.448 s) : 0, 10447822
Agent [candidate] (1.2 s) : 0, 1199647
Total [candidate] (10.524 s) : 0, 10524246
section iast
Agent [baseline] (1.212 s) : 0, 1211872
Total [baseline] (10.693 s) : 0, 10692775
Agent [candidate] (1.203 s) : 0, 1202804
Total [candidate] (10.765 s) : 0, 10764817
section profiling
Agent [baseline] (1.269 s) : 0, 1268815
Total [baseline] (10.645 s) : 0, 10644550
Agent [candidate] (1.271 s) : 0, 1270967
Total [candidate] (10.599 s) : 0, 10598713
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.076 s -
Agent appsec 1.198 s 121.788 ms (11.3%)
Agent iast 1.212 s 135.632 ms (12.6%)
Agent profiling 1.269 s 192.575 ms (17.9%)
Total tracing 10.426 s -
Total appsec 10.448 s 21.487 ms (0.2%)
Total iast 10.693 s 266.44 ms (2.6%)
Total profiling 10.645 s 218.215 ms (2.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.077 s -
Agent appsec 1.2 s 122.36 ms (11.4%)
Agent iast 1.203 s 125.517 ms (11.7%)
Agent profiling 1.271 s 193.68 ms (18.0%)
Total tracing 10.356 s -
Total appsec 10.524 s 168.23 ms (1.6%)
Total iast 10.765 s 408.801 ms (3.9%)
Total profiling 10.599 s 242.697 ms (2.3%) 
gantt
    title petclinic - break down per module: candidate=1.34.0-SNAPSHOT~da32d188e5, baseline=1.34.0-SNAPSHOT~23683a0e6f

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (673.913 ms) : 0, 673913
BytebuddyAgent [candidate] (675.027 ms) : 0, 675027
GlobalTracer [baseline] (310.4 ms) : 0, 310400
GlobalTracer [candidate] (310.218 ms) : 0, 310218
AppSec [baseline] (49.31 ms) : 0, 49310
AppSec [candidate] (49.414 ms) : 0, 49414
Remote Config [baseline] (657.429 µs) : 0, 657
Remote Config [candidate] (669.989 µs) : 0, 670
Telemetry [baseline] (7.584 ms) : 0, 7584
Telemetry [candidate] (7.597 ms) : 0, 7597
section appsec
BytebuddyAgent [baseline] (701.277 ms) : 0, 701277
BytebuddyAgent [candidate] (702.004 ms) : 0, 702004
GlobalTracer [baseline] (294.942 ms) : 0, 294942
GlobalTracer [candidate] (293.751 ms) : 0, 293751
AppSec [baseline] (149.298 ms) : 0, 149298
AppSec [candidate] (149.956 ms) : 0, 149956
IAST [baseline] (19.408 ms) : 0, 19408
IAST [candidate] (19.37 ms) : 0, 19370
Remote Config [baseline] (622.673 µs) : 0, 623
Remote Config [candidate] (629.48 µs) : 0, 629
Telemetry [baseline] (7.555 ms) : 0, 7555
Telemetry [candidate] (8.877 ms) : 0, 8877
section iast
BytebuddyAgent [baseline] (800.764 ms) : 0, 800764
BytebuddyAgent [candidate] (796.578 ms) : 0, 796578
GlobalTracer [baseline] (293.777 ms) : 0, 293777
GlobalTracer [candidate] (289.117 ms) : 0, 289117
AppSec [baseline] (52.073 ms) : 0, 52073
AppSec [candidate] (48.622 ms) : 0, 48622
IAST [baseline] (21.854 ms) : 0, 21854
IAST [candidate] (25.729 ms) : 0, 25729
Remote Config [baseline] (592.189 µs) : 0, 592
Remote Config [candidate] (1.504 ms) : 0, 1504
Telemetry [baseline] (8.048 ms) : 0, 8048
Telemetry [candidate] (6.685 ms) : 0, 6685
section profiling
BytebuddyAgent [baseline] (677.824 ms) : 0, 677824
BytebuddyAgent [candidate] (679.343 ms) : 0, 679343
GlobalTracer [baseline] (381.022 ms) : 0, 381022
GlobalTracer [candidate] (380.725 ms) : 0, 380725
AppSec [baseline] (50.07 ms) : 0, 50070
AppSec [candidate] (50.28 ms) : 0, 50280
Remote Config [baseline] (703.25 µs) : 0, 703
Remote Config [candidate] (717.32 µs) : 0, 717
Telemetry [baseline] (7.503 ms) : 0, 7503
Telemetry [candidate] (7.508 ms) : 0, 7508
ProfilingAgent [baseline] (95.204 ms) : 0, 95204
ProfilingAgent [candidate] (95.631 ms) : 0, 95631
Profiling [baseline] (95.229 ms) : 0, 95229
Profiling [candidate] (95.655 ms) : 0, 95655
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.34.0-SNAPSHOT~da32d188e5, baseline=1.34.0-SNAPSHOT~23683a0e6f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.079 s) : 0, 1078946
Total [baseline] (8.555 s) : 0, 8555188
Agent [candidate] (1.082 s) : 0, 1081993
Total [candidate] (8.556 s) : 0, 8556178
section iast
Agent [baseline] (1.209 s) : 0, 1208929
Total [baseline] (9.0 s) : 0, 8999965
Agent [candidate] (1.204 s) : 0, 1203766
Total [candidate] (9.014 s) : 0, 9013995
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.211 s) : 0, 1211071
Total [baseline] (9.045 s) : 0, 9044950
Agent [candidate] (1.212 s) : 0, 1212281
Total [candidate] (9.001 s) : 0, 9001126
section iast_TELEMETRY_OFF
Agent [baseline] (1.197 s) : 0, 1197077
Total [baseline] (8.988 s) : 0, 8988229
Agent [candidate] (1.218 s) : 0, 1218147
Total [candidate] (9.036 s) : 0, 9035949
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.079 s -
Agent iast 1.209 s 129.983 ms (12.0%)
Agent iast_HARDCODED_SECRET_DISABLED 1.211 s 132.125 ms (12.2%)
Agent iast_TELEMETRY_OFF 1.197 s 118.131 ms (10.9%)
Total tracing 8.555 s -
Total iast 9.0 s 444.777 ms (5.2%)
Total iast_HARDCODED_SECRET_DISABLED 9.045 s 489.762 ms (5.7%)
Total iast_TELEMETRY_OFF 8.988 s 433.041 ms (5.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.082 s -
Agent iast 1.204 s 121.773 ms (11.3%)
Agent iast_HARDCODED_SECRET_DISABLED 1.212 s 130.288 ms (12.0%)
Agent iast_TELEMETRY_OFF 1.218 s 136.154 ms (12.6%)
Total tracing 8.556 s -
Total iast 9.014 s 457.817 ms (5.4%)
Total iast_HARDCODED_SECRET_DISABLED 9.001 s 444.948 ms (5.2%)
Total iast_TELEMETRY_OFF 9.036 s 479.77 ms (5.6%) 
gantt
    title insecure-bank - break down per module: candidate=1.34.0-SNAPSHOT~da32d188e5, baseline=1.34.0-SNAPSHOT~23683a0e6f

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (675.247 ms) : 0, 675247
BytebuddyAgent [candidate] (678.191 ms) : 0, 678191
GlobalTracer [baseline] (311.481 ms) : 0, 311481
GlobalTracer [candidate] (311.323 ms) : 0, 311323
AppSec [baseline] (49.573 ms) : 0, 49573
AppSec [candidate] (49.55 ms) : 0, 49550
Remote Config [baseline] (661.98 µs) : 0, 662
Remote Config [candidate] (663.165 µs) : 0, 663
Telemetry [baseline] (7.499 ms) : 0, 7499
Telemetry [candidate] (7.639 ms) : 0, 7639
section iast
BytebuddyAgent [baseline] (799.217 ms) : 0, 799217
BytebuddyAgent [candidate] (796.854 ms) : 0, 796854
GlobalTracer [baseline] (292.558 ms) : 0, 292558
GlobalTracer [candidate] (289.469 ms) : 0, 289469
AppSec [baseline] (49.61 ms) : 0, 49610
AppSec [candidate] (50.567 ms) : 0, 50567
IAST [baseline] (24.27 ms) : 0, 24270
IAST [candidate] (25.044 ms) : 0, 25044
Remote Config [baseline] (1.979 ms) : 0, 1979
Remote Config [candidate] (608.979 µs) : 0, 609
Telemetry [baseline] (6.687 ms) : 0, 6687
Telemetry [candidate] (6.681 ms) : 0, 6681
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (800.065 ms) : 0, 800065
BytebuddyAgent [candidate] (803.059 ms) : 0, 803059
GlobalTracer [baseline] (292.666 ms) : 0, 292666
GlobalTracer [candidate] (290.863 ms) : 0, 290863
AppSec [baseline] (49.288 ms) : 0, 49288
AppSec [candidate] (51.001 ms) : 0, 51001
IAST [baseline] (27.069 ms) : 0, 27069
IAST [candidate] (25.303 ms) : 0, 25303
Remote Config [baseline] (599.722 µs) : 0, 600
Remote Config [candidate] (581.343 µs) : 0, 581
Telemetry [baseline] (6.641 ms) : 0, 6641
Telemetry [candidate] (6.698 ms) : 0, 6698
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (790.235 ms) : 0, 790235
BytebuddyAgent [candidate] (809.152 ms) : 0, 809152
GlobalTracer [baseline] (290.469 ms) : 0, 290469
GlobalTracer [candidate] (291.838 ms) : 0, 291838
AppSec [baseline] (51.443 ms) : 0, 51443
AppSec [candidate] (51.95 ms) : 0, 51950
IAST [baseline] (22.88 ms) : 0, 22880
IAST [candidate] (22.999 ms) : 0, 22999
Remote Config [baseline] (598.891 µs) : 0, 599
Remote Config [candidate] (569.425 µs) : 0, 569
Telemetry [baseline] (7.225 ms) : 0, 7225
Telemetry [candidate] (6.584 ms) : 0, 6584
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-05-07T12:51:48 2024-05-07T12:58:38
git_branch master jpbempel/filter-out-errors
git_commit_date 1715083491 1715085441
git_commit_sha 23683a0 da32d18
release_version 1.34.0-SNAPSHOT~23683a0e6f 1.34.0-SNAPSHOT~da32d188e5
start_time 2024-05-07T12:51:35 2024-05-07T12:58:25
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1715087063 1715087063
ci_job_id 506114748 506114748
ci_pipeline_id 33757535 33757535
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 16 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:petclinic:profiling better
[-96.810µs; -41.852µs] or [-6.181%; -2.672%]		 unstable
[-436.516op/s; +664.436op/s] or [-14.732%; +22.425%]		 1.497ms 3076.923op/s 1.566ms 2962.963op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.34.0-SNAPSHOT~da32d188e5, baseline=1.34.0-SNAPSHOT~23683a0e6f
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.354 ms) : 1334, 1373
.   : milestone, 1354,
appsec (1.728 ms) : 1705, 1752
.   : milestone, 1728,
appsec_no_iast (1.71 ms) : 1686, 1735
.   : milestone, 1710,
iast (1.502 ms) : 1479, 1524
.   : milestone, 1502,
profiling (1.566 ms) : 1540, 1592
.   : milestone, 1566,
tracing (1.505 ms) : 1480, 1529
.   : milestone, 1505,
section candidate
no_agent (1.332 ms) : 1312, 1352
.   : milestone, 1332,
appsec (1.731 ms) : 1707, 1754
.   : milestone, 1731,
appsec_no_iast (1.726 ms) : 1702, 1750
.   : milestone, 1726,
iast (1.489 ms) : 1465, 1512
.   : milestone, 1489,
profiling (1.497 ms) : 1472, 1522
.   : milestone, 1497,
tracing (1.492 ms) : 1467, 1518
.   : milestone, 1492,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.354 ms [1.334 ms, 1.373 ms] -
appsec 1.728 ms [1.705 ms, 1.752 ms] 374.591 µs (27.7%)
appsec_no_iast 1.71 ms [1.686 ms, 1.735 ms] 356.548 µs (26.3%)
iast 1.502 ms [1.479 ms, 1.524 ms] 147.679 µs (10.9%)
profiling 1.566 ms [1.54 ms, 1.592 ms] 212.518 µs (15.7%)
tracing 1.505 ms [1.48 ms, 1.529 ms] 150.695 µs (11.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.332 ms [1.312 ms, 1.352 ms] -
appsec 1.731 ms [1.707 ms, 1.754 ms] 398.751 µs (29.9%)
appsec_no_iast 1.726 ms [1.702 ms, 1.75 ms] 393.85 µs (29.6%)
iast 1.489 ms [1.465 ms, 1.512 ms] 156.829 µs (11.8%)
profiling 1.497 ms [1.472 ms, 1.522 ms] 165.199 µs (12.4%)
tracing 1.492 ms [1.467 ms, 1.518 ms] 160.63 µs (12.1%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.34.0-SNAPSHOT~da32d188e5, baseline=1.34.0-SNAPSHOT~23683a0e6f
    dateFormat X
    axisFormat %s
section baseline
no_agent (370.464 µs) : 351, 390
.   : milestone, 370,
iast (477.222 µs) : 456, 498
.   : milestone, 477,
iast_FULL (541.18 µs) : 520, 563
.   : milestone, 541,
iast_GLOBAL (491.288 µs) : 471, 512
.   : milestone, 491,
iast_HARDCODED_SECRET_DISABLED (477.711 µs) : 457, 499
.   : milestone, 478,
iast_INACTIVE (448.746 µs) : 427, 470
.   : milestone, 449,
iast_TELEMETRY_OFF (472.53 µs) : 451, 494
.   : milestone, 473,
tracing (451.276 µs) : 430, 472
.   : milestone, 451,
section candidate
no_agent (371.129 µs) : 352, 391
.   : milestone, 371,
iast (476.147 µs) : 456, 497
.   : milestone, 476,
iast_FULL (538.209 µs) : 518, 559
.   : milestone, 538,
iast_GLOBAL (508.013 µs) : 486, 530
.   : milestone, 508,
iast_HARDCODED_SECRET_DISABLED (479.078 µs) : 458, 500
.   : milestone, 479,
iast_INACTIVE (446.443 µs) : 426, 467
.   : milestone, 446,
iast_TELEMETRY_OFF (472.473 µs) : 451, 494
.   : milestone, 472,
tracing (443.691 µs) : 423, 464
.   : milestone, 444,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 370.464 µs [351.031 µs, 389.897 µs] -
iast 477.222 µs [456.392 µs, 498.052 µs] 106.758 µs (28.8%)
iast_FULL 541.18 µs [519.855 µs, 562.504 µs] 170.716 µs (46.1%)
iast_GLOBAL 491.288 µs [470.908 µs, 511.667 µs] 120.823 µs (32.6%)
iast_HARDCODED_SECRET_DISABLED 477.711 µs [456.763 µs, 498.659 µs] 107.247 µs (28.9%)
iast_INACTIVE 448.746 µs [427.457 µs, 470.035 µs] 78.282 µs (21.1%)
iast_TELEMETRY_OFF 472.53 µs [451.283 µs, 493.777 µs] 102.066 µs (27.6%)
tracing 451.276 µs [430.338 µs, 472.213 µs] 80.812 µs (21.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 371.129 µs [351.747 µs, 390.511 µs] -
iast 476.147 µs [455.699 µs, 496.595 µs] 105.018 µs (28.3%)
iast_FULL 538.209 µs [517.836 µs, 558.582 µs] 167.08 µs (45.0%)
iast_GLOBAL 508.013 µs [485.874 µs, 530.151 µs] 136.884 µs (36.9%)
iast_HARDCODED_SECRET_DISABLED 479.078 µs [457.871 µs, 500.284 µs] 107.949 µs (29.1%)
iast_INACTIVE 446.443 µs [425.975 µs, 466.911 µs] 75.314 µs (20.3%)
iast_TELEMETRY_OFF 472.473 µs [451.399 µs, 493.547 µs] 101.344 µs (27.3%)
tracing 443.691 µs [423.305 µs, 464.077 µs] 72.562 µs (19.6%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/filter-out-errors
git_commit_date 1715083491 1715085441
git_commit_sha 23683a0 da32d18
release_version 1.34.0-SNAPSHOT~23683a0e6f 1.34.0-SNAPSHOT~da32d188e5
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1715087569 1715087569
ci_job_id 506114750 506114750
ci_pipeline_id 33757535 33757535
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.34.0-SNAPSHOT~da32d188e5, baseline=1.34.0-SNAPSHOT~23683a0e6f
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.496 s) : 15496000, 15496000
.   : milestone, 15496000,
appsec (15.164 s) : 15164000, 15164000
.   : milestone, 15164000,
iast (18.939 s) : 18939000, 18939000
.   : milestone, 18939000,
iast_GLOBAL (18.005 s) : 18005000, 18005000
.   : milestone, 18005000,
profiling (14.957 s) : 14957000, 14957000
.   : milestone, 14957000,
tracing (15.211 s) : 15211000, 15211000
.   : milestone, 15211000,
section candidate
no_agent (14.966 s) : 14966000, 14966000
.   : milestone, 14966000,
appsec (14.867 s) : 14867000, 14867000
.   : milestone, 14867000,
iast (18.834 s) : 18834000, 18834000
.   : milestone, 18834000,
iast_GLOBAL (17.819 s) : 17819000, 17819000
.   : milestone, 17819000,
profiling (15.265 s) : 15265000, 15265000
.   : milestone, 15265000,
tracing (14.989 s) : 14989000, 14989000
.   : milestone, 14989000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.496 s [15.496 s, 15.496 s] -
appsec 15.164 s [15.164 s, 15.164 s] -332.0 ms (-2.1%)
iast 18.939 s [18.939 s, 18.939 s] 3.443 s (22.2%)
iast_GLOBAL 18.005 s [18.005 s, 18.005 s] 2.509 s (16.2%)
profiling 14.957 s [14.957 s, 14.957 s] -539.0 ms (-3.5%)
tracing 15.211 s [15.211 s, 15.211 s] -285.0 ms (-1.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.966 s [14.966 s, 14.966 s] -
appsec 14.867 s [14.867 s, 14.867 s] -99.0 ms (-0.7%)
iast 18.834 s [18.834 s, 18.834 s] 3.868 s (25.8%)
iast_GLOBAL 17.819 s [17.819 s, 17.819 s] 2.853 s (19.1%)
profiling 15.265 s [15.265 s, 15.265 s] 299.0 ms (2.0%)
tracing 14.989 s [14.989 s, 14.989 s] 23.0 ms (0.2%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.34.0-SNAPSHOT~da32d188e5, baseline=1.34.0-SNAPSHOT~23683a0e6f
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.462 ms) : 1450, 1473
.   : milestone, 1462,
appsec (2.196 ms) : 2162, 2230
.   : milestone, 2196,
iast (1.894 ms) : 1858, 1930
.   : milestone, 1894,
iast_GLOBAL (1.92 ms) : 1884, 1955
.   : milestone, 1920,
profiling (1.853 ms) : 1820, 1886
.   : milestone, 1853,
tracing (1.821 ms) : 1789, 1852
.   : milestone, 1821,
section candidate
no_agent (1.464 ms) : 1453, 1476
.   : milestone, 1464,
appsec (2.197 ms) : 2163, 2231
.   : milestone, 2197,
iast (1.874 ms) : 1839, 1909
.   : milestone, 1874,
iast_GLOBAL (1.914 ms) : 1879, 1949
.   : milestone, 1914,
profiling (1.85 ms) : 1816, 1884
.   : milestone, 1850,
tracing (1.824 ms) : 1792, 1855
.   : milestone, 1824,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.462 ms [1.45 ms, 1.473 ms] -
appsec 2.196 ms [2.162 ms, 2.23 ms] 734.292 µs (50.2%)
iast 1.894 ms [1.858 ms, 1.93 ms] 432.623 µs (29.6%)
iast_GLOBAL 1.92 ms [1.884 ms, 1.955 ms] 458.272 µs (31.4%)
profiling 1.853 ms [1.82 ms, 1.886 ms] 391.414 µs (26.8%)
tracing 1.821 ms [1.789 ms, 1.852 ms] 358.86 µs (24.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.464 ms [1.453 ms, 1.476 ms] -
appsec 2.197 ms [2.163 ms, 2.231 ms] 732.671 µs (50.0%)
iast 1.874 ms [1.839 ms, 1.909 ms] 409.892 µs (28.0%)
iast_GLOBAL 1.914 ms [1.879 ms, 1.949 ms] 449.551 µs (30.7%)
profiling 1.85 ms [1.816 ms, 1.884 ms] 385.933 µs (26.4%)
tracing 1.824 ms [1.792 ms, 1.855 ms] 359.431 µs (24.5%)

@jpbempel jpbempel merged commit 1f14de5 into master May 13, 2024
80 of 82 checks passed
@jpbempel jpbempel deleted the jpbempel/filter-out-errors branch May 13, 2024 15:44
@github-actions github-actions bot added this to the 1.35.0 milestone May 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@shatzi shatzi shatzi approved these changes

Assignees
No one assigned
Labels
comp: debugger Dynamic Instrumentation
Projects
None yet
Milestone
1.35.0
Development

Successfully merging this pull request may close these issues.
2 participants
@jpbempel @shatzi