Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add smoke test for quarkus native #7525

Merged
merged 1 commit into from
Aug 28, 2024
Merged

Add smoke test for quarkus native #7525

merged 1 commit into from
Aug 28, 2024

Conversation

amarziali
Copy link
Collaborator

@amarziali amarziali commented Aug 28, 2024 •
edited by jira bot
Loading

What Does This Do

Add a smoke test for quarkus native (we previously had issues with building the native image for quarkus native). It does the same as the regular quarkus smoke test (and it testes a newer version) and the build is strongly inspired from the spring native one.

Motivation

Additional Notes

Jira ticket: AIDM-270

@amarziali amarziali requested a review from a team as a code owner August 28, 2024 12:53
@amarziali amarziali added the comp: testing Testing label Aug 28, 2024
@pr-commenter
Copy link

pr-commenter bot commented Aug 28, 2024

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/quarkus-native-smoke
git_commit_date 1724845827 1724849513
git_commit_sha 01d9133 4d157c0
release_version 1.39.0-SNAPSHOT~01d9133076 1.39.0-SNAPSHOT~4d157c0932
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1724851771 1724851771
ci_job_id 619902587 619902587
ci_pipeline_id 43027113 43027113
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 49 metrics, 14 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.39.0-SNAPSHOT~4d157c0932, baseline=1.39.0-SNAPSHOT~01d9133076

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.056 s) : 0, 1056229
Total [baseline] (10.388 s) : 0, 10387867
Agent [candidate] (1.062 s) : 0, 1061662
Total [candidate] (10.481 s) : 0, 10481395
section appsec
Agent [baseline] (1.183 s) : 0, 1182692
Total [baseline] (10.501 s) : 0, 10500796
Agent [candidate] (1.174 s) : 0, 1174492
Total [candidate] (10.412 s) : 0, 10412439
section iast
Agent [baseline] (1.18 s) : 0, 1179623
Total [baseline] (10.877 s) : 0, 10877387
Agent [candidate] (1.19 s) : 0, 1190405
Total [candidate] (10.855 s) : 0, 10855234
section profiling
Agent [baseline] (1.246 s) : 0, 1245618
Total [baseline] (10.581 s) : 0, 10580517
Agent [candidate] (1.25 s) : 0, 1249987
Total [candidate] (10.556 s) : 0, 10556424
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.056 s -
Agent appsec 1.183 s 126.463 ms (12.0%)
Agent iast 1.18 s 123.394 ms (11.7%)
Agent profiling 1.246 s 189.389 ms (17.9%)
Total tracing 10.388 s -
Total appsec 10.501 s 112.929 ms (1.1%)
Total iast 10.877 s 489.519 ms (4.7%)
Total profiling 10.581 s 192.65 ms (1.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.062 s -
Agent appsec 1.174 s 112.829 ms (10.6%)
Agent iast 1.19 s 128.742 ms (12.1%)
Agent profiling 1.25 s 188.325 ms (17.7%)
Total tracing 10.481 s -
Total appsec 10.412 s -68.956 ms (-0.7%)
Total iast 10.855 s 373.838 ms (3.6%)
Total profiling 10.556 s 75.029 ms (0.7%) 
gantt
    title petclinic - break down per module: candidate=1.39.0-SNAPSHOT~4d157c0932, baseline=1.39.0-SNAPSHOT~01d9133076

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (673.521 ms) : 0, 673521
BytebuddyAgent [candidate] (677.683 ms) : 0, 677683
GlobalTracer [baseline] (308.977 ms) : 0, 308977
GlobalTracer [candidate] (309.976 ms) : 0, 309976
AppSec [baseline] (51.799 ms) : 0, 51799
AppSec [candidate] (51.978 ms) : 0, 51978
Remote Config [baseline] (675.151 µs) : 0, 675
Remote Config [candidate] (681.024 µs) : 0, 681
Telemetry [baseline] (7.582 ms) : 0, 7582
Telemetry [candidate] (7.587 ms) : 0, 7587
section appsec
BytebuddyAgent [baseline] (686.149 ms) : 0, 686149
BytebuddyAgent [candidate] (681.015 ms) : 0, 681015
GlobalTracer [baseline] (303.799 ms) : 0, 303799
GlobalTracer [candidate] (301.385 ms) : 0, 301385
AppSec [baseline] (162.231 ms) : 0, 162231
AppSec [candidate] (161.431 ms) : 0, 161431
Remote Config [baseline] (646.433 µs) : 0, 646
Remote Config [candidate] (643.885 µs) : 0, 644
Telemetry [baseline] (6.844 ms) : 0, 6844
Telemetry [candidate] (7.131 ms) : 0, 7131
IAST [baseline] (18.553 ms) : 0, 18553
IAST [candidate] (18.493 ms) : 0, 18493
section iast
BytebuddyAgent [baseline] (783.98 ms) : 0, 783980
BytebuddyAgent [candidate] (790.962 ms) : 0, 790962
GlobalTracer [baseline] (297.892 ms) : 0, 297892
GlobalTracer [candidate] (300.338 ms) : 0, 300338
AppSec [baseline] (49.845 ms) : 0, 49845
AppSec [candidate] (51.07 ms) : 0, 51070
Remote Config [baseline] (599.08 µs) : 0, 599
Remote Config [candidate] (622.336 µs) : 0, 622
Telemetry [baseline] (7.169 ms) : 0, 7169
Telemetry [candidate] (8.857 ms) : 0, 8857
IAST [baseline] (26.444 ms) : 0, 26444
IAST [candidate] (24.739 ms) : 0, 24739
section profiling
ProfilingAgent [baseline] (95.525 ms) : 0, 95525
ProfilingAgent [candidate] (96.626 ms) : 0, 96626
BytebuddyAgent [baseline] (663.189 ms) : 0, 663189
BytebuddyAgent [candidate] (665.0 ms) : 0, 665000
GlobalTracer [baseline] (389.473 ms) : 0, 389473
GlobalTracer [candidate] (390.186 ms) : 0, 390186
AppSec [baseline] (52.134 ms) : 0, 52134
AppSec [candidate] (52.584 ms) : 0, 52584
Remote Config [baseline] (685.258 µs) : 0, 685
Remote Config [candidate] (694.682 µs) : 0, 695
Telemetry [baseline] (7.311 ms) : 0, 7311
Telemetry [candidate] (7.398 ms) : 0, 7398
Profiling [baseline] (95.549 ms) : 0, 95549
Profiling [candidate] (96.65 ms) : 0, 96650
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.39.0-SNAPSHOT~4d157c0932, baseline=1.39.0-SNAPSHOT~01d9133076

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.049 s) : 0, 1049050
Total [baseline] (8.552 s) : 0, 8552471
Agent [candidate] (1.048 s) : 0, 1048009
Total [candidate] (8.503 s) : 0, 8502846
section iast
Agent [baseline] (1.178 s) : 0, 1177940
Total [baseline] (8.959 s) : 0, 8959364
Agent [candidate] (1.172 s) : 0, 1171563
Total [candidate] (8.969 s) : 0, 8969099
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.174 s) : 0, 1173512
Total [baseline] (8.919 s) : 0, 8918881
Agent [candidate] (1.171 s) : 0, 1170941
Total [candidate] (8.934 s) : 0, 8934208
section iast_TELEMETRY_OFF
Agent [baseline] (1.169 s) : 0, 1168941
Total [baseline] (8.952 s) : 0, 8951774
Agent [candidate] (1.167 s) : 0, 1167129
Total [candidate] (8.941 s) : 0, 8941141
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.049 s -
Agent iast 1.178 s 128.89 ms (12.3%)
Agent iast_HARDCODED_SECRET_DISABLED 1.174 s 124.462 ms (11.9%)
Agent iast_TELEMETRY_OFF 1.169 s 119.891 ms (11.4%)
Total tracing 8.552 s -
Total iast 8.959 s 406.893 ms (4.8%)
Total iast_HARDCODED_SECRET_DISABLED 8.919 s 366.41 ms (4.3%)
Total iast_TELEMETRY_OFF 8.952 s 399.302 ms (4.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.048 s -
Agent iast 1.172 s 123.554 ms (11.8%)
Agent iast_HARDCODED_SECRET_DISABLED 1.171 s 122.932 ms (11.7%)
Agent iast_TELEMETRY_OFF 1.167 s 119.12 ms (11.4%)
Total tracing 8.503 s -
Total iast 8.969 s 466.253 ms (5.5%)
Total iast_HARDCODED_SECRET_DISABLED 8.934 s 431.362 ms (5.1%)
Total iast_TELEMETRY_OFF 8.941 s 438.295 ms (5.2%) 
gantt
    title insecure-bank - break down per module: candidate=1.39.0-SNAPSHOT~4d157c0932, baseline=1.39.0-SNAPSHOT~01d9133076

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (669.138 ms) : 0, 669138
BytebuddyAgent [candidate] (668.807 ms) : 0, 668807
GlobalTracer [baseline] (306.946 ms) : 0, 306946
GlobalTracer [candidate] (306.031 ms) : 0, 306031
AppSec [baseline] (51.268 ms) : 0, 51268
AppSec [candidate] (51.348 ms) : 0, 51348
Remote Config [baseline] (659.503 µs) : 0, 660
Remote Config [candidate] (672.352 µs) : 0, 672
Telemetry [baseline] (7.458 ms) : 0, 7458
Telemetry [candidate] (7.569 ms) : 0, 7569
section iast
BytebuddyAgent [baseline] (782.622 ms) : 0, 782622
BytebuddyAgent [candidate] (777.656 ms) : 0, 777656
GlobalTracer [baseline] (297.486 ms) : 0, 297486
GlobalTracer [candidate] (295.718 ms) : 0, 295718
AppSec [baseline] (49.853 ms) : 0, 49853
AppSec [candidate] (48.836 ms) : 0, 48836
IAST [baseline] (26.567 ms) : 0, 26567
IAST [candidate] (23.365 ms) : 0, 23365
Remote Config [baseline] (591.35 µs) : 0, 591
Remote Config [candidate] (607.017 µs) : 0, 607
Telemetry [baseline] (7.177 ms) : 0, 7177
Telemetry [candidate] (11.769 ms) : 0, 11769
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (779.467 ms) : 0, 779467
BytebuddyAgent [candidate] (777.925 ms) : 0, 777925
GlobalTracer [baseline] (296.572 ms) : 0, 296572
GlobalTracer [candidate] (295.782 ms) : 0, 295782
AppSec [baseline] (50.579 ms) : 0, 50579
AppSec [candidate] (49.474 ms) : 0, 49474
IAST [baseline] (24.037 ms) : 0, 24037
IAST [candidate] (25.669 ms) : 0, 25669
Remote Config [baseline] (584.505 µs) : 0, 585
Remote Config [candidate] (582.602 µs) : 0, 583
Telemetry [baseline] (8.681 ms) : 0, 8681
Telemetry [candidate] (7.894 ms) : 0, 7894
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (775.399 ms) : 0, 775399
BytebuddyAgent [candidate] (773.747 ms) : 0, 773747
GlobalTracer [baseline] (296.364 ms) : 0, 296364
GlobalTracer [candidate] (295.607 ms) : 0, 295607
AppSec [baseline] (48.973 ms) : 0, 48973
AppSec [candidate] (51.154 ms) : 0, 51154
IAST [baseline] (23.878 ms) : 0, 23878
IAST [candidate] (23.099 ms) : 0, 23099
Remote Config [baseline] (588.566 µs) : 0, 589
Remote Config [candidate] (585.484 µs) : 0, 585
Telemetry [baseline] (10.132 ms) : 0, 10132
Telemetry [candidate] (9.344 ms) : 0, 9344
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-08-28T13:00:16 2024-08-28T13:07:07
git_branch master andrea.marziali/quarkus-native-smoke
git_commit_date 1724845827 1724849513
git_commit_sha 01d9133 4d157c0
release_version 1.39.0-SNAPSHOT~01d9133076 1.39.0-SNAPSHOT~4d157c0932
start_time 2024-08-28T13:00:02 2024-08-28T13:06:54
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1724850774 1724850774
ci_job_id 619902589 619902589
ci_pipeline_id 43027113 43027113
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 16 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.39.0-SNAPSHOT~4d157c0932, baseline=1.39.0-SNAPSHOT~01d9133076
    dateFormat X
    axisFormat %s
section baseline
no_agent (374.448 µs) : 354, 395
.   : milestone, 374,
iast (493.557 µs) : 470, 517
.   : milestone, 494,
iast_FULL (554.295 µs) : 533, 575
.   : milestone, 554,
iast_GLOBAL (523.414 µs) : 501, 545
.   : milestone, 523,
iast_HARDCODED_SECRET_DISABLED (490.936 µs) : 469, 513
.   : milestone, 491,
iast_INACTIVE (449.443 µs) : 429, 470
.   : milestone, 449,
iast_TELEMETRY_OFF (478.751 µs) : 456, 501
.   : milestone, 479,
tracing (449.252 µs) : 428, 470
.   : milestone, 449,
section candidate
no_agent (371.757 µs) : 352, 391
.   : milestone, 372,
iast (489.702 µs) : 467, 512
.   : milestone, 490,
iast_FULL (564.725 µs) : 543, 586
.   : milestone, 565,
iast_GLOBAL (508.058 µs) : 487, 529
.   : milestone, 508,
iast_HARDCODED_SECRET_DISABLED (493.808 µs) : 471, 516
.   : milestone, 494,
iast_INACTIVE (448.153 µs) : 427, 469
.   : milestone, 448,
iast_TELEMETRY_OFF (477.805 µs) : 456, 500
.   : milestone, 478,
tracing (446.834 µs) : 426, 467
.   : milestone, 447,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 374.448 µs [354.071 µs, 394.825 µs] -
iast 493.557 µs [470.484 µs, 516.629 µs] 119.109 µs (31.8%)
iast_FULL 554.295 µs [533.194 µs, 575.397 µs] 179.847 µs (48.0%)
iast_GLOBAL 523.414 µs [501.365 µs, 545.464 µs] 148.967 µs (39.8%)
iast_HARDCODED_SECRET_DISABLED 490.936 µs [468.519 µs, 513.353 µs] 116.488 µs (31.1%)
iast_INACTIVE 449.443 µs [428.547 µs, 470.34 µs] 74.996 µs (20.0%)
iast_TELEMETRY_OFF 478.751 µs [456.088 µs, 501.415 µs] 104.303 µs (27.9%)
tracing 449.252 µs [428.453 µs, 470.051 µs] 74.805 µs (20.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 371.757 µs [352.402 µs, 391.113 µs] -
iast 489.702 µs [467.111 µs, 512.293 µs] 117.945 µs (31.7%)
iast_FULL 564.725 µs [543.456 µs, 585.994 µs] 192.968 µs (51.9%)
iast_GLOBAL 508.058 µs [486.977 µs, 529.139 µs] 136.301 µs (36.7%)
iast_HARDCODED_SECRET_DISABLED 493.808 µs [471.492 µs, 516.125 µs] 122.051 µs (32.8%)
iast_INACTIVE 448.153 µs [427.288 µs, 469.018 µs] 76.396 µs (20.5%)
iast_TELEMETRY_OFF 477.805 µs [455.527 µs, 500.083 µs] 106.048 µs (28.5%)
tracing 446.834 µs [426.168 µs, 467.5 µs] 75.077 µs (20.2%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.39.0-SNAPSHOT~4d157c0932, baseline=1.39.0-SNAPSHOT~01d9133076
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.339 ms) : 1319, 1358
.   : milestone, 1339,
appsec (1.716 ms) : 1693, 1739
.   : milestone, 1716,
appsec_no_iast (1.75 ms) : 1726, 1774
.   : milestone, 1750,
iast (1.479 ms) : 1457, 1501
.   : milestone, 1479,
profiling (1.488 ms) : 1465, 1511
.   : milestone, 1488,
tracing (1.489 ms) : 1466, 1513
.   : milestone, 1489,
section candidate
no_agent (1.34 ms) : 1320, 1359
.   : milestone, 1340,
appsec (1.728 ms) : 1705, 1752
.   : milestone, 1728,
appsec_no_iast (1.726 ms) : 1702, 1750
.   : milestone, 1726,
iast (1.475 ms) : 1452, 1498
.   : milestone, 1475,
profiling (1.508 ms) : 1484, 1533
.   : milestone, 1508,
tracing (1.447 ms) : 1422, 1471
.   : milestone, 1447,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.339 ms [1.319 ms, 1.358 ms] -
appsec 1.716 ms [1.693 ms, 1.739 ms] 377.668 µs (28.2%)
appsec_no_iast 1.75 ms [1.726 ms, 1.774 ms] 411.016 µs (30.7%)
iast 1.479 ms [1.457 ms, 1.501 ms] 140.641 µs (10.5%)
profiling 1.488 ms [1.465 ms, 1.511 ms] 149.145 µs (11.1%)
tracing 1.489 ms [1.466 ms, 1.513 ms] 150.684 µs (11.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.34 ms [1.32 ms, 1.359 ms] -
appsec 1.728 ms [1.705 ms, 1.752 ms] 388.512 µs (29.0%)
appsec_no_iast 1.726 ms [1.702 ms, 1.75 ms] 386.622 µs (28.9%)
iast 1.475 ms [1.452 ms, 1.498 ms] 135.542 µs (10.1%)
profiling 1.508 ms [1.484 ms, 1.533 ms] 168.738 µs (12.6%)
tracing 1.447 ms [1.422 ms, 1.471 ms] 106.98 µs (8.0%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/quarkus-native-smoke
git_commit_date 1724845827 1724849513
git_commit_sha 01d9133 4d157c0
release_version 1.39.0-SNAPSHOT~01d9133076 1.39.0-SNAPSHOT~4d157c0932
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1724851403 1724851403
ci_job_id 619902592 619902592
ci_pipeline_id 43027113 43027113
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.39.0-SNAPSHOT~4d157c0932, baseline=1.39.0-SNAPSHOT~01d9133076
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.456 ms) : 1444, 1467
.   : milestone, 1456,
appsec (2.219 ms) : 2184, 2254
.   : milestone, 2219,
iast (1.968 ms) : 1925, 2011
.   : milestone, 1968,
iast_GLOBAL (2.015 ms) : 1972, 2058
.   : milestone, 2015,
profiling (1.857 ms) : 1823, 1891
.   : milestone, 1857,
tracing (1.831 ms) : 1798, 1863
.   : milestone, 1831,
section candidate
no_agent (1.453 ms) : 1442, 1464
.   : milestone, 1453,
appsec (2.218 ms) : 2182, 2253
.   : milestone, 2218,
iast (1.966 ms) : 1924, 2008
.   : milestone, 1966,
iast_GLOBAL (2.008 ms) : 1965, 2051
.   : milestone, 2008,
profiling (1.849 ms) : 1815, 1883
.   : milestone, 1849,
tracing (1.841 ms) : 1808, 1874
.   : milestone, 1841,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.456 ms [1.444 ms, 1.467 ms] -
appsec 2.219 ms [2.184 ms, 2.254 ms] 762.795 µs (52.4%)
iast 1.968 ms [1.925 ms, 2.011 ms] 512.366 µs (35.2%)
iast_GLOBAL 2.015 ms [1.972 ms, 2.058 ms] 559.513 µs (38.4%)
profiling 1.857 ms [1.823 ms, 1.891 ms] 401.208 µs (27.6%)
tracing 1.831 ms [1.798 ms, 1.863 ms] 374.945 µs (25.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.453 ms [1.442 ms, 1.464 ms] -
appsec 2.218 ms [2.182 ms, 2.253 ms] 764.538 µs (52.6%)
iast 1.966 ms [1.924 ms, 2.008 ms] 512.943 µs (35.3%)
iast_GLOBAL 2.008 ms [1.965 ms, 2.051 ms] 554.683 µs (38.2%)
profiling 1.849 ms [1.815 ms, 1.883 ms] 395.719 µs (27.2%)
tracing 1.841 ms [1.808 ms, 1.874 ms] 387.442 µs (26.7%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.39.0-SNAPSHOT~4d157c0932, baseline=1.39.0-SNAPSHOT~01d9133076
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.081 s) : 15081000, 15081000
.   : milestone, 15081000,
appsec (14.936 s) : 14936000, 14936000
.   : milestone, 14936000,
iast (18.854 s) : 18854000, 18854000
.   : milestone, 18854000,
iast_GLOBAL (17.758 s) : 17758000, 17758000
.   : milestone, 17758000,
profiling (15.739 s) : 15739000, 15739000
.   : milestone, 15739000,
tracing (15.054 s) : 15054000, 15054000
.   : milestone, 15054000,
section candidate
no_agent (15.031 s) : 15031000, 15031000
.   : milestone, 15031000,
appsec (15.22 s) : 15220000, 15220000
.   : milestone, 15220000,
iast (18.908 s) : 18908000, 18908000
.   : milestone, 18908000,
iast_GLOBAL (17.803 s) : 17803000, 17803000
.   : milestone, 17803000,
profiling (15.005 s) : 15005000, 15005000
.   : milestone, 15005000,
tracing (15.268 s) : 15268000, 15268000
.   : milestone, 15268000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.081 s [15.081 s, 15.081 s] -
appsec 14.936 s [14.936 s, 14.936 s] -145.0 ms (-1.0%)
iast 18.854 s [18.854 s, 18.854 s] 3.773 s (25.0%)
iast_GLOBAL 17.758 s [17.758 s, 17.758 s] 2.677 s (17.8%)
profiling 15.739 s [15.739 s, 15.739 s] 658.0 ms (4.4%)
tracing 15.054 s [15.054 s, 15.054 s] -27.0 ms (-0.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.031 s [15.031 s, 15.031 s] -
appsec 15.22 s [15.22 s, 15.22 s] 189.0 ms (1.3%)
iast 18.908 s [18.908 s, 18.908 s] 3.877 s (25.8%)
iast_GLOBAL 17.803 s [17.803 s, 17.803 s] 2.772 s (18.4%)
profiling 15.005 s [15.005 s, 15.005 s] -26.0 ms (-0.2%)
tracing 15.268 s [15.268 s, 15.268 s] 237.0 ms (1.6%)

PerfectSlayer
PerfectSlayer approved these changes Aug 28, 2024
View reviewed changes
Copy link
Contributor

@PerfectSlayer PerfectSlayer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the addition 👍
Pretty similar to spring-boot-3.0-native

@amarziali amarziali merged commit 78086bf into master Aug 28, 2024
92 checks passed
@amarziali amarziali deleted the andrea.marziali/quarkus-native-smoke branch August 28, 2024 13:49
@github-actions github-actions bot added this to the 1.39.0 milestone Aug 28, 2024
@PerfectSlayer PerfectSlayer added the tag: no release notes Changes to exclude from release notes label Sep 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@PerfectSlayer PerfectSlayer PerfectSlayer approved these changes

@nayeem-kamal nayeem-kamal Awaiting requested review from nayeem-kamal nayeem-kamal is a code owner automatically assigned from DataDog/apm-java

Assignees
No one assigned
Labels
comp: testing Testing tag: no release notes Changes to exclude from release notes
Projects
None yet
Milestone
1.39.0
Development

Successfully merging this pull request may close these issues.
2 participants
@amarziali @PerfectSlayer