Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[NO-TICKET] Validate that all public symbols are prefixed in Ruby releases #573

Merged
merged 1 commit into from
Aug 5, 2024

Conversation

ivoanjo
Copy link
Member

@ivoanjo ivoanjo commented Aug 5, 2024

What does this PR do?

This PR adds a check during packaging of Ruby releases that all symbols exported in the libdatadog shared library are correctly prefixed.

Motivation

This allows us to catch any new unprefixed symbols, and thus we're able to rely on libdatadog not exporting symbols that would clash with other libraries that may be loaded in the same Ruby VM.

Additional Notes

N/A

How to test the change?

You can observe the new check running with docker-compose run push_to_rubygems.

This is safe to call as it'll stop asking for credentials before actually publishing anything to rubygems.

…eases

**What does this PR do?**

This PR adds a check during packaging of Ruby releases that all symbols
exported in the libdatadog shared library are correctly prefixed.

**Motivation:**

This allows us to catch any new unprefixed symbols, and thus we're
able to rely on libdatadog not exporting symbols that would clash with
other libraries that may be loaded in the same Ruby VM.

**Additional Notes:**

N/A

**How to test the change?**

You can observe the new check running with
`docker-compose run push_to_rubygems`.

This is safe to call as it'll stop asking for credentials before
actually publishing anything to rubygems.
@ivoanjo ivoanjo requested a review from a team as a code owner August 5, 2024 08:24
@codecov-commenter
Copy link

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 70.24%. Comparing base (866b79d) to head (9533108).

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #573      +/-   ##
==========================================
- Coverage   70.28%   70.24%   -0.05%     
==========================================
  Files         214      214              
  Lines       28785    28802      +17     
==========================================
  Hits        20231    20231              
- Misses       8554     8571      +17     
Components Coverage Δ
crashtracker 21.20% <ø> (ø)
datadog-alloc 98.73% <ø> (ø)
data-pipeline 50.00% <ø> (ø)
data-pipeline-ffi 0.00% <ø> (ø)
ddcommon 83.07% <ø> (ø)
ddcommon-ffi 70.20% <ø> (ø)
ddtelemetry 58.95% <ø> (ø)
ipc 84.18% <ø> (ø)
profiling 84.26% <ø> (ø)
profiling-ffi 77.42% <ø> (ø)
serverless 0.00% <ø> (ø)
sidecar 34.55% <ø> (ø)
sidecar-ffi 0.00% <ø> (ø)
spawn-worker 54.87% <ø> (ø)
trace-mini-agent 70.88% <ø> (ø)
trace-normalization 98.24% <ø> (ø)
trace-obfuscation 95.73% <ø> (ø)
trace-protobuf 77.16% <ø> (ø)
trace-utils 90.90% <ø> (-0.59%) ⬇️

@pr-commenter
Copy link

pr-commenter bot commented Aug 5, 2024

Benchmarks

Comparison

Benchmark execution time: 2024-08-05 08:40:36

Comparing candidate commit 9533108 in PR branch ivoanjo/test-exported-symbols with baseline commit 866b79d in branch main.

Found 1 performance improvements and 1 performance regressions! Performance is the same for 40 metrics, 2 unstable metrics.

scenario:normalization/normalize_trace/test_trace

  • 🟩 execution_time [-13.370ns; -10.830ns] or [-2.751%; -2.228%]

scenario:tags/replace_trace_tags

  • 🟥 execution_time [+149.365ns; +154.528ns] or [+3.459%; +3.579%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz 9533108 1722846007 ivoanjo/test-exported-symbols
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 106.043µs 106.241µs ± 0.089µs 106.235µs ± 0.037µs 106.267µs 106.358µs 106.556µs 106.821µs 0.55% 2.601 12.762 0.08% 0.006µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [106.228µs; 106.253µs] or [-0.012%; +0.012%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz 9533108 1722846007 ivoanjo/test-exported-symbols
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 4.433µs 4.470µs ± 0.015µs 4.470µs ± 0.011µs 4.481µs 4.494µs 4.500µs 4.505µs 0.78% -0.022 -0.672 0.34% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [4.468µs; 4.472µs] or [-0.047%; +0.047%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz 9533108 1722846007 ivoanjo/test-exported-symbols
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 28.983µs 53.418µs ± 12.379µs 54.382µs ± 1.599µs 56.677µs 67.298µs 84.397µs 132.304µs 143.29% 0.816 8.102 23.12% 0.875µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [51.703µs; 55.134µs] or [-3.212%; +3.212%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz 9533108 1722846007 ivoanjo/test-exported-symbols
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 188.058µs 188.598µs ± 0.214µs 188.574µs ± 0.118µs 188.701µs 188.928µs 189.331µs 189.786µs 0.64% 1.404 5.202 0.11% 0.015µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [188.568µs; 188.628µs] or [-0.016%; +0.016%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz 9533108 1722846007 ivoanjo/test-exported-symbols
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 3.221µs 4.152µs ± 2.714µs 3.908µs ± 0.043µs 3.949µs 4.077µs 5.644µs 34.300µs 777.76% 9.983 100.099 65.20% 0.192µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.776µs; 4.528µs] or [-9.059%; +9.059%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz 9533108 1722846007 ivoanjo/test-exported-symbols
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 6.800ns 6.908ns ± 0.099ns 6.886ns ± 0.075ns 6.962ns 7.084ns 7.209ns 7.215ns 4.78% 1.079 0.839 1.44% 0.007ns 1 200
credit_card/is_card_number/ throughput 138608800.689op/s 144785589.963op/s ± 2052764.078op/s 145230334.466op/s ± 1598009.635op/s 146827274.901op/s 146899508.728op/s 147045432.202op/s 147050648.460op/s 1.25% -1.009 0.623 1.41% 145152.340op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 125.014ns 127.094ns ± 0.970ns 127.211ns ± 0.744ns 127.801ns 128.534ns 129.096ns 129.182ns 1.55% -0.145 -0.757 0.76% 0.069ns 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 7741015.633op/s 7868659.726op/s ± 60153.589op/s 7860944.838op/s ± 45810.882op/s 7913695.994op/s 7972122.210op/s 7997403.206op/s 7999097.690op/s 1.76% 0.173 -0.749 0.76% 4253.501op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 121.036ns 123.071ns ± 0.676ns 123.220ns ± 0.460ns 123.567ns 123.913ns 124.174ns 124.353ns 0.92% -0.723 0.216 0.55% 0.048ns 1 200
credit_card/is_card_number/ 378282246310005 throughput 8041636.839op/s 8125659.948op/s ± 44811.413op/s 8115570.683op/s ± 30408.779op/s 8151824.327op/s 8207250.587op/s 8258452.524op/s 8261989.510op/s 1.80% 0.751 0.275 0.55% 3168.645op/s 1 200
credit_card/is_card_number/37828224631 execution_time 6.800ns 6.911ns ± 0.108ns 6.891ns ± 0.063ns 6.947ns 7.138ns 7.212ns 7.505ns 8.92% 1.790 4.854 1.55% 0.008ns 1 200
credit_card/is_card_number/37828224631 throughput 133237220.141op/s 144720374.363op/s ± 2194447.531op/s 145119481.789op/s ± 1325007.116op/s 146522255.335op/s 146902328.238op/s 147051359.290op/s 147054035.796op/s 1.33% -1.632 3.896 1.51% 155170.873op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 117.983ns 119.832ns ± 0.821ns 119.983ns ± 0.579ns 120.542ns 120.868ns 121.018ns 121.233ns 1.04% -0.594 -0.603 0.68% 0.058ns 1 200
credit_card/is_card_number/378282246310005 throughput 8248599.802op/s 8345405.601op/s ± 57393.761op/s 8334547.198op/s ± 40112.763op/s 8383451.124op/s 8460558.287op/s 8471845.557op/s 8475810.258op/s 1.69% 0.615 -0.577 0.69% 4058.352op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 106.593ns 108.348ns ± 0.450ns 108.516ns ± 0.078ns 108.552ns 108.775ns 108.949ns 108.957ns 0.41% -2.127 4.267 0.41% 0.032ns 1 200
credit_card/is_card_number/37828224631000521389798 throughput 9177895.169op/s 9229685.313op/s ± 38637.707op/s 9215237.832op/s ± 6644.247op/s 9230184.219op/s 9328709.481op/s 9371069.782op/s 9381473.948op/s 1.80% 2.149 4.354 0.42% 2732.098op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 61.289ns 62.947ns ± 0.739ns 63.085ns ± 0.524ns 63.591ns 63.755ns 63.906ns 64.128ns 1.65% -0.712 -0.652 1.17% 0.052ns 1 200
credit_card/is_card_number/x371413321323331 throughput 15593872.162op/s 15888665.656op/s ± 188222.535op/s 15851646.987op/s ± 130701.722op/s 16041709.991op/s 16248785.539op/s 16310132.862op/s 16316081.655op/s 2.93% 0.742 -0.609 1.18% 13309.343op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 7.202ns 7.305ns ± 0.113ns 7.273ns ± 0.063ns 7.353ns 7.600ns 7.614ns 7.679ns 5.58% 1.430 1.454 1.54% 0.008ns 1 200
credit_card/is_card_number_no_luhn/ throughput 130232911.729op/s 136916081.441op/s ± 2069571.626op/s 137500566.978op/s ± 1209137.583op/s 138698443.002op/s 138744432.261op/s 138776523.715op/s 138840711.264op/s 0.97% -1.366 1.253 1.51% 146340.813op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 107.164ns 109.193ns ± 0.890ns 109.254ns ± 0.632ns 109.843ns 110.520ns 111.261ns 111.992ns 2.51% 0.074 -0.226 0.81% 0.063ns 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 8929201.389op/s 9158667.317op/s ± 74647.776op/s 9153004.907op/s ± 52690.542op/s 9211294.620op/s 9283011.715op/s 9297141.517op/s 9331458.235op/s 1.95% -0.031 -0.276 0.81% 5278.395op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 102.551ns 104.643ns ± 0.766ns 104.700ns ± 0.411ns 105.174ns 105.763ns 105.970ns 106.019ns 1.26% -0.501 -0.167 0.73% 0.054ns 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 9432285.231op/s 9556790.659op/s ± 70212.518op/s 9551119.117op/s ± 37528.833op/s 9585261.275op/s 9694713.291op/s 9720975.826op/s 9751219.621op/s 2.10% 0.535 -0.127 0.73% 4964.775op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 7.200ns 7.280ns ± 0.090ns 7.246ns ± 0.037ns 7.333ns 7.458ns 7.610ns 7.612ns 5.05% 1.461 1.942 1.23% 0.006ns 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 131378317.162op/s 137381561.766op/s ± 1664087.056op/s 138012696.556op/s ± 709694.613op/s 138703420.219op/s 138740111.758op/s 138881106.568op/s 138883958.513op/s 0.63% -1.397 1.657 1.21% 117668.724op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 99.886ns 101.804ns ± 0.723ns 101.807ns ± 0.485ns 102.289ns 102.985ns 103.315ns 103.454ns 1.62% -0.019 -0.318 0.71% 0.051ns 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 9666113.526op/s 9823285.048op/s ± 69829.857op/s 9822532.529op/s ± 46638.699op/s 9869187.959op/s 9931868.340op/s 9995155.121op/s 10011449.803op/s 1.92% 0.055 -0.305 0.71% 4937.717op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 106.754ns 108.712ns ± 0.666ns 108.753ns ± 0.444ns 109.211ns 109.736ns 109.802ns 110.155ns 1.29% -0.599 0.284 0.61% 0.047ns 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 9078104.232op/s 9198968.753op/s ± 56556.981op/s 9195159.698op/s ± 37631.880op/s 9230110.528op/s 9308952.006op/s 9353670.898op/s 9367347.462op/s 1.87% 0.634 0.343 0.61% 3999.183op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 61.577ns 63.423ns ± 0.625ns 63.572ns ± 0.366ns 63.859ns 64.190ns 64.426ns 64.503ns 1.46% -0.987 0.611 0.98% 0.044ns 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 15503267.230op/s 15768651.501op/s ± 156990.005op/s 15730145.720op/s ± 90448.155op/s 15850788.150op/s 16134739.239op/s 16202989.777op/s 16239899.391op/s 3.24% 1.036 0.718 0.99% 11100.870op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [6.894ns; 6.922ns] or [-0.199%; +0.199%] None None None
credit_card/is_card_number/ throughput [144501096.604op/s; 145070083.322op/s] or [-0.196%; +0.196%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [126.959ns; 127.228ns] or [-0.106%; +0.106%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [7860323.017op/s; 7876996.435op/s] or [-0.106%; +0.106%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [122.977ns; 123.164ns] or [-0.076%; +0.076%] None None None
credit_card/is_card_number/ 378282246310005 throughput [8119449.517op/s; 8131870.379op/s] or [-0.076%; +0.076%] None None None
credit_card/is_card_number/37828224631 execution_time [6.897ns; 6.926ns] or [-0.216%; +0.216%] None None None
credit_card/is_card_number/37828224631 throughput [144416245.040op/s; 145024503.685op/s] or [-0.210%; +0.210%] None None None
credit_card/is_card_number/378282246310005 execution_time [119.718ns; 119.946ns] or [-0.095%; +0.095%] None None None
credit_card/is_card_number/378282246310005 throughput [8337451.378op/s; 8353359.825op/s] or [-0.095%; +0.095%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [108.286ns; 108.410ns] or [-0.058%; +0.058%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [9224330.498op/s; 9235040.127op/s] or [-0.058%; +0.058%] None None None
credit_card/is_card_number/x371413321323331 execution_time [62.844ns; 63.049ns] or [-0.163%; +0.163%] None None None
credit_card/is_card_number/x371413321323331 throughput [15862579.823op/s; 15914751.489op/s] or [-0.164%; +0.164%] None None None
credit_card/is_card_number_no_luhn/ execution_time [7.290ns; 7.321ns] or [-0.214%; +0.214%] None None None
credit_card/is_card_number_no_luhn/ throughput [136629258.718op/s; 137202904.164op/s] or [-0.209%; +0.209%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [109.070ns; 109.317ns] or [-0.113%; +0.113%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [9148321.853op/s; 9169012.781op/s] or [-0.113%; +0.113%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [104.537ns; 104.749ns] or [-0.101%; +0.101%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [9547059.879op/s; 9566521.439op/s] or [-0.102%; +0.102%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [7.268ns; 7.293ns] or [-0.171%; +0.171%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [137150935.304op/s; 137612188.227op/s] or [-0.168%; +0.168%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [101.704ns; 101.904ns] or [-0.098%; +0.098%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [9813607.301op/s; 9832962.795op/s] or [-0.099%; +0.099%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [108.620ns; 108.804ns] or [-0.085%; +0.085%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [9191130.499op/s; 9206807.007op/s] or [-0.085%; +0.085%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [63.337ns; 63.510ns] or [-0.137%; +0.137%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [15746894.196op/s; 15790408.805op/s] or [-0.138%; +0.138%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz 9533108 1722846007 ivoanjo/test-exported-symbols
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 291.812ns 293.077ns ± 0.349ns 293.114ns ± 0.065ns 293.164ns 293.300ns 293.542ns 296.743ns 1.24% 5.169 60.701 0.12% 0.025ns 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 46.812ns 47.710ns ± 0.226ns 47.710ns ± 0.114ns 47.869ns 48.042ns 48.127ns 48.197ns 1.02% -0.807 1.733 0.47% 0.016ns 1 200
normalization/normalize_name/normalize_name/good execution_time 33.102ns 33.968ns ± 0.769ns 33.893ns ± 0.273ns 34.208ns 34.446ns 34.837ns 43.502ns 28.35% 9.585 116.715 2.26% 0.054ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [293.028ns; 293.125ns] or [-0.017%; +0.017%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [47.679ns; 47.741ns] or [-0.066%; +0.066%] None None None
normalization/normalize_name/normalize_name/good execution_time [33.862ns; 34.075ns] or [-0.314%; +0.314%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz 9533108 1722846007 ivoanjo/test-exported-symbols
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 468.011ns 473.979ns ± 5.651ns 472.891ns ± 1.465ns 474.429ns 481.307ns 484.227ns 536.218ns 13.39% 6.952 71.848 1.19% 0.400ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [473.196ns; 474.762ns] or [-0.165%; +0.165%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz 9533108 1722846007 ivoanjo/test-exported-symbols
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 3.673µs 3.690µs ± 0.015µs 3.686µs ± 0.003µs 3.689µs 3.716µs 3.717µs 3.848µs 4.41% 6.022 55.702 0.41% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [3.688µs; 3.692µs] or [-0.058%; +0.058%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz 9533108 1722846007 ivoanjo/test-exported-symbols
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 65.674µs 65.910µs ± 0.046µs 65.918µs ± 0.022µs 65.937µs 65.965µs 65.991µs 66.088µs 0.26% -1.090 5.713 0.07% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [65.903µs; 65.916µs] or [-0.010%; +0.010%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz 9533108 1722846007 ivoanjo/test-exported-symbols
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 619.857ns 625.046ns ± 3.503ns 626.331ns ± 2.832ns 627.882ns 629.507ns 630.026ns 636.345ns 1.60% -0.006 -1.104 0.56% 0.248ns 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 575.030ns 588.374ns ± 5.470ns 587.340ns ± 3.079ns 590.943ns 599.067ns 604.295ns 605.857ns 3.15% 0.854 0.743 0.93% 0.387ns 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 225.975ns 239.372ns ± 9.402ns 246.441ns ± 0.468ns 246.728ns 247.332ns 248.099ns 249.297ns 1.16% -0.520 -1.679 3.92% 0.665ns 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 92.496ns 108.502ns ± 14.000ns 103.619ns ± 8.705ns 127.670ns 128.317ns 128.514ns 128.667ns 24.17% 0.540 -1.456 12.87% 0.990ns 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 91.996ns 106.181ns ± 14.102ns 98.475ns ± 5.874ns 123.955ns 126.036ns 126.948ns 127.128ns 29.10% 0.511 -1.617 13.25% 0.997ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [624.560ns; 625.531ns] or [-0.078%; +0.078%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [587.616ns; 589.132ns] or [-0.129%; +0.129%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [238.069ns; 240.675ns] or [-0.544%; +0.544%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [106.562ns; 110.443ns] or [-1.788%; +1.788%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [104.227ns; 108.136ns] or [-1.841%; +1.841%] None None None

Baseline

Omitted due to size.

@ivoanjo ivoanjo merged commit a84d949 into main Aug 5, 2024
43 checks passed
@ivoanjo ivoanjo deleted the ivoanjo/test-exported-symbols branch August 5, 2024 09:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants