Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[chore] Number RFCs so they're easier to reference #580

Merged
merged 2 commits into from
Aug 6, 2024
Merged

Conversation

danielsn
Copy link
Contributor

@danielsn danielsn commented Aug 6, 2024

What does this PR do?

What it says in the title

Motivation

As we add more RFCs, having them numbered makes them easier to refer to.

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

@danielsn danielsn requested a review from a team as a code owner August 6, 2024 17:47
@codecov-commenter
Copy link

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 71.27%. Comparing base (7a0e111) to head (db09cd9).

Additional details and impacted files
@@           Coverage Diff           @@
##             main     #580   +/-   ##
=======================================
  Coverage   71.27%   71.27%           
=======================================
  Files         219      219           
  Lines       29918    29918           
=======================================
  Hits        21323    21323           
  Misses       8595     8595           
Components Coverage Δ
crashtracker 21.20% <ø> (ø)
datadog-alloc 98.73% <ø> (ø)
data-pipeline 50.00% <ø> (ø)
data-pipeline-ffi 0.00% <ø> (ø)
ddcommon 83.07% <ø> (ø)
ddcommon-ffi 70.20% <ø> (ø)
ddtelemetry 58.95% <ø> (ø)
ipc 84.18% <ø> (ø)
profiling 84.26% <ø> (ø)
profiling-ffi 77.42% <ø> (ø)
serverless 0.00% <ø> (ø)
sidecar 34.55% <ø> (ø)
sidecar-ffi 0.00% <ø> (ø)
spawn-worker 54.87% <ø> (ø)
trace-mini-agent 70.88% <ø> (ø)
trace-normalization 98.24% <ø> (ø)
trace-obfuscation 95.73% <ø> (ø)
trace-protobuf 77.16% <ø> (ø)
trace-utils 92.96% <ø> (ø)

@pr-commenter
Copy link

pr-commenter bot commented Aug 6, 2024

Benchmarks

Comparison

Benchmark execution time: 2024-08-06 18:03:11

Comparing candidate commit db09cd9 in PR branch dsn/number-rfc with baseline commit 7a0e111 in branch main.

Found 2 performance improvements and 0 performance regressions! Performance is the same for 40 metrics, 2 unstable metrics.

scenario:normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて

  • 🟩 execution_time [-10.976ns; -9.985ns] or [-2.397%; -2.181%]

scenario:tags/replace_trace_tags

  • 🟩 execution_time [-119.499ns; -117.803ns] or [-4.997%; -4.927%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz db09cd9 1722966564 dsn/number-rfc
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.263µs 2.273µs ± 0.004µs 2.273µs ± 0.003µs 2.276µs 2.278µs 2.279µs 2.291µs 0.77% -0.052 0.459 0.19% 0.000µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.272µs; 2.273µs] or [-0.026%; +0.026%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz db09cd9 1722966564 dsn/number-rfc
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 35.841µs 35.955µs ± 0.098µs 35.932µs ± 0.024µs 35.961µs 36.090µs 36.159µs 37.007µs 2.99% 6.651 66.095 0.27% 0.007µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [35.942µs; 35.969µs] or [-0.038%; +0.038%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz db09cd9 1722966564 dsn/number-rfc
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.942µs 2.975µs ± 1.821µs 2.794µs ± 0.018µs 2.811µs 3.050µs 4.488µs 24.110µs 763.05% 10.199 106.634 61.08% 0.129µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [2.722µs; 3.227µs] or [-8.486%; +8.486%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz db09cd9 1722966564 dsn/number-rfc
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 321.364ns 331.537ns ± 7.501ns 330.214ns ± 3.092ns 333.036ns 348.110ns 350.302ns 364.938ns 10.52% 1.454 2.466 2.26% 0.530ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [330.497ns; 332.577ns] or [-0.314%; +0.314%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz db09cd9 1722966564 dsn/number-rfc
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 266.061ns 271.477ns ± 3.113ns 271.363ns ± 2.162ns 273.397ns 276.835ns 279.813ns 282.255ns 4.01% 0.628 0.329 1.14% 0.220ns 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 34.199ns 35.209ns ± 0.251ns 35.220ns ± 0.086ns 35.280ns 35.504ns 36.224ns 36.424ns 3.42% 1.226 6.769 0.71% 0.018ns 1 200
normalization/normalize_name/normalize_name/good execution_time 24.282ns 25.186ns ± 0.305ns 25.212ns ± 0.160ns 25.325ns 25.579ns 26.063ns 26.891ns 6.66% 0.760 4.900 1.21% 0.022ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [271.046ns; 271.908ns] or [-0.159%; +0.159%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [35.175ns; 35.244ns] or [-0.099%; +0.099%] None None None
normalization/normalize_name/normalize_name/good execution_time [25.144ns; 25.228ns] or [-0.168%; +0.168%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz db09cd9 1722966564 dsn/number-rfc
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.423ns 3.591ns ± 0.027ns 3.600ns ± 0.003ns 3.602ns 3.603ns 3.604ns 3.617ns 0.47% -4.692 24.441 0.76% 0.002ns 1 200
credit_card/is_card_number/ throughput 276499501.282op/s 278520966.305op/s ± 2189408.778op/s 277807141.600op/s ± 231070.495op/s 278665358.428op/s 280889103.806op/s 291782659.739op/s 292105611.864op/s 5.15% 4.793 25.347 0.78% 154814.579op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 84.442ns 87.076ns ± 0.769ns 87.016ns ± 0.462ns 87.496ns 88.422ns 89.261ns 90.089ns 3.53% 0.521 1.674 0.88% 0.054ns 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 11100139.329op/s 11485165.768op/s ± 100950.300op/s 11492167.484op/s ± 60691.245op/s 11547684.911op/s 11636238.690op/s 11674602.328op/s 11842480.067op/s 3.05% -0.432 1.572 0.88% 7138.264op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 80.995ns 82.491ns ± 0.692ns 82.445ns ± 0.408ns 82.833ns 83.700ns 84.621ns 84.866ns 2.94% 0.534 0.819 0.84% 0.049ns 1 200
credit_card/is_card_number/ 378282246310005 throughput 11783259.885op/s 12123383.630op/s ± 101311.503op/s 12129260.616op/s ± 59759.077op/s 12193867.914op/s 12296693.754op/s 12324715.172op/s 12346367.583op/s 1.79% -0.471 0.707 0.83% 7163.805op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.527ns 3.597ns ± 0.011ns 3.601ns ± 0.002ns 3.602ns 3.604ns 3.606ns 3.647ns 1.30% -1.853 10.787 0.30% 0.001ns 1 200
credit_card/is_card_number/37828224631 throughput 274162380.652op/s 278042789.920op/s ± 847768.658op/s 277717885.263op/s ± 169286.308op/s 278256158.352op/s 279667733.831op/s 280569645.206op/s 283562355.124op/s 2.10% 1.938 11.096 0.30% 59946.297op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 77.651ns 80.151ns ± 0.709ns 80.163ns ± 0.413ns 80.603ns 81.266ns 81.837ns 82.702ns 3.17% -0.100 1.341 0.88% 0.050ns 1 200
credit_card/is_card_number/378282246310005 throughput 12091593.501op/s 12477364.631op/s ± 110531.014op/s 12474584.173op/s ± 64221.911op/s 12534645.248op/s 12658724.417op/s 12744632.141op/s 12878175.919op/s 3.24% 0.189 1.380 0.88% 7815.723op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 66.831ns 68.141ns ± 0.426ns 68.171ns ± 0.223ns 68.336ns 68.788ns 69.564ns 70.000ns 2.68% 0.291 3.008 0.62% 0.030ns 1 200
credit_card/is_card_number/37828224631000521389798 throughput 14285783.855op/s 14676067.493op/s ± 91647.981op/s 14668892.405op/s ± 48068.284op/s 14729597.294op/s 14829524.802op/s 14942566.002op/s 14963061.863op/s 2.01% -0.200 2.855 0.62% 6480.491op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 21.201ns 22.514ns ± 0.413ns 22.544ns ± 0.257ns 22.802ns 23.105ns 23.383ns 23.613ns 4.74% -0.405 0.346 1.83% 0.029ns 1 200
credit_card/is_card_number/x371413321323331 throughput 42350300.605op/s 44431385.163op/s ± 821064.764op/s 44358574.078op/s ± 503708.454op/s 44863121.500op/s 46147339.814op/s 46409618.146op/s 47168634.159op/s 6.33% 0.525 0.460 1.84% 58058.046op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.266ns 3.429ns ± 0.016ns 3.431ns ± 0.000ns 3.431ns 3.433ns 3.437ns 3.442ns 0.32% -9.704 93.198 0.48% 0.001ns 1 200
credit_card/is_card_number_no_luhn/ throughput 290534718.855op/s 291596909.864op/s ± 1456997.441op/s 291465460.864op/s ± 41318.755op/s 291501963.387op/s 291603952.551op/s 292044700.226op/s 306223046.349op/s 5.06% 9.718 93.384 0.50% 103025.277op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 67.204ns 69.124ns ± 0.561ns 69.087ns ± 0.248ns 69.332ns 69.981ns 70.828ns 71.977ns 4.18% 0.553 5.134 0.81% 0.040ns 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 13893325.240op/s 14467678.888op/s ± 116874.738op/s 14474546.740op/s ± 51740.995op/s 14529048.805op/s 14641536.681op/s 14866904.079op/s 14880036.434op/s 2.80% -0.389 4.863 0.81% 8264.292op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 62.889ns 64.247ns ± 0.477ns 64.245ns ± 0.263ns 64.475ns 64.981ns 65.325ns 67.573ns 5.18% 1.764 11.082 0.74% 0.034ns 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 14798747.309op/s 15565745.215op/s ± 114096.545op/s 15565453.566op/s ± 63537.873op/s 15633382.683op/s 15716860.726op/s 15806333.379op/s 15901137.710op/s 2.16% -1.553 9.520 0.73% 8067.844op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.266ns 3.429ns ± 0.016ns 3.431ns ± 0.000ns 3.431ns 3.433ns 3.435ns 3.447ns 0.47% -9.691 93.072 0.47% 0.001ns 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 290114348.764op/s 291602276.467op/s ± 1455373.839op/s 291470883.828op/s ± 40382.385op/s 291505925.705op/s 291625589.274op/s 291973065.062op/s 306223814.029op/s 5.06% 9.707 93.277 0.50% 102910.471op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 59.747ns 61.853ns ± 0.585ns 61.855ns ± 0.327ns 62.211ns 62.694ns 62.962ns 63.134ns 2.07% -0.891 2.128 0.94% 0.041ns 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 15839275.277op/s 16168843.631op/s ± 154378.903op/s 16166925.642op/s ± 85011.644op/s 16244974.486op/s 16443695.963op/s 16736724.176op/s 16737359.568op/s 3.53% 0.987 2.413 0.95% 10916.237op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 66.002ns 67.730ns ± 0.462ns 67.770ns ± 0.205ns 67.967ns 68.305ns 69.093ns 69.212ns 2.13% -0.547 3.343 0.68% 0.033ns 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 14448427.941op/s 14765102.554op/s ± 101087.897op/s 14755699.104op/s ± 44619.758op/s 14801276.116op/s 14946338.699op/s 15109358.533op/s 15151086.464op/s 2.68% 0.650 3.450 0.68% 7147.994op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 21.115ns 22.217ns ± 0.354ns 22.182ns ± 0.208ns 22.427ns 22.870ns 23.139ns 23.350ns 5.27% 0.309 0.537 1.59% 0.025ns 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 42826251.736op/s 45022740.645op/s ± 713862.626op/s 45081326.813op/s ± 419332.877op/s 45458352.676op/s 46106115.979op/s 46680850.673op/s 47358928.020op/s 5.05% -0.192 0.523 1.58% 50477.710op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.587ns; 3.594ns] or [-0.105%; +0.105%] None None None
credit_card/is_card_number/ throughput [278217535.305op/s; 278824397.304op/s] or [-0.109%; +0.109%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [86.969ns; 87.182ns] or [-0.122%; +0.122%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [11471175.028op/s; 11499156.509op/s] or [-0.122%; +0.122%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [82.395ns; 82.587ns] or [-0.116%; +0.116%] None None None
credit_card/is_card_number/ 378282246310005 throughput [12109342.830op/s; 12137424.430op/s] or [-0.116%; +0.116%] None None None
credit_card/is_card_number/37828224631 execution_time [3.595ns; 3.598ns] or [-0.042%; +0.042%] None None None
credit_card/is_card_number/37828224631 throughput [277925297.337op/s; 278160282.502op/s] or [-0.042%; +0.042%] None None None
credit_card/is_card_number/378282246310005 execution_time [80.053ns; 80.250ns] or [-0.123%; +0.123%] None None None
credit_card/is_card_number/378282246310005 throughput [12462046.096op/s; 12492683.167op/s] or [-0.123%; +0.123%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [68.082ns; 68.200ns] or [-0.087%; +0.087%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [14663365.964op/s; 14688769.022op/s] or [-0.087%; +0.087%] None None None
credit_card/is_card_number/x371413321323331 execution_time [22.457ns; 22.571ns] or [-0.254%; +0.254%] None None None
credit_card/is_card_number/x371413321323331 throughput [44317593.484op/s; 44545176.843op/s] or [-0.256%; +0.256%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.427ns; 3.432ns] or [-0.066%; +0.066%] None None None
credit_card/is_card_number_no_luhn/ throughput [291394984.032op/s; 291798835.697op/s] or [-0.069%; +0.069%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [69.046ns; 69.202ns] or [-0.112%; +0.112%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [14451481.173op/s; 14483876.603op/s] or [-0.112%; +0.112%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [64.181ns; 64.313ns] or [-0.103%; +0.103%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [15549932.531op/s; 15581557.899op/s] or [-0.102%; +0.102%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.427ns; 3.432ns] or [-0.066%; +0.066%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [291400575.650op/s; 291803977.283op/s] or [-0.069%; +0.069%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [61.772ns; 61.934ns] or [-0.131%; +0.131%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [16147448.200op/s; 16190239.062op/s] or [-0.132%; +0.132%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [67.666ns; 67.794ns] or [-0.094%; +0.094%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [14751092.744op/s; 14779112.364op/s] or [-0.095%; +0.095%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [22.168ns; 22.266ns] or [-0.221%; +0.221%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [44923806.151op/s; 45121675.139op/s] or [-0.220%; +0.220%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz db09cd9 1722966564 dsn/number-rfc
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 68.086µs 68.502µs ± 0.085µs 68.495µs ± 0.024µs 68.519µs 68.589µs 68.637µs 69.416µs 1.35% 5.885 67.954 0.12% 0.006µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [68.490µs; 68.514µs] or [-0.017%; +0.017%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz db09cd9 1722966564 dsn/number-rfc
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.707µs 38.752µs ± 34.595µs 37.567µs ± 2.862µs 40.418µs 50.846µs 106.797µs 496.189µs 1220.80% 11.712 151.603 89.05% 2.446µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [33.957µs; 43.546µs] or [-12.372%; +12.372%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz db09cd9 1722966564 dsn/number-rfc
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 1.352µs 1.355µs ± 0.001µs 1.355µs ± 0.000µs 1.355µs 1.356µs 1.356µs 1.359µs 0.27% 0.439 10.129 0.05% 0.000µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [1.355µs; 1.355µs] or [-0.006%; +0.006%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz db09cd9 1722966564 dsn/number-rfc
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 133.196µs 133.598µs ± 0.199µs 133.581µs ± 0.098µs 133.677µs 133.822µs 134.295µs 135.145µs 1.17% 3.054 18.764 0.15% 0.014µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [133.571µs; 133.626µs] or [-0.021%; +0.021%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz db09cd9 1722966564 dsn/number-rfc
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 657.622ns 659.066ns ± 0.450ns 659.042ns ± 0.255ns 659.300ns 659.702ns 660.289ns 661.965ns 0.44% 1.295 8.697 0.07% 0.032ns 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 442.289ns 447.417ns ± 2.246ns 447.064ns ± 0.439ns 447.582ns 450.584ns 453.083ns 472.470ns 5.68% 7.489 77.016 0.50% 0.159ns 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 229.664ns 232.769ns ± 2.353ns 234.223ns ± 1.412ns 234.893ns 235.542ns 236.271ns 236.486ns 0.97% -0.100 -1.845 1.01% 0.166ns 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 37.032ns 43.266ns ± 7.187ns 39.832ns ± 2.212ns 46.128ns 58.948ns 59.253ns 59.809ns 50.16% 1.375 0.532 16.57% 0.508ns 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 72.411ns 77.175ns ± 4.569ns 75.621ns ± 0.638ns 83.927ns 84.964ns 85.417ns 85.577ns 13.17% 0.878 -0.844 5.91% 0.323ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [659.003ns; 659.128ns] or [-0.009%; +0.009%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [447.106ns; 447.729ns] or [-0.070%; +0.070%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [232.443ns; 233.095ns] or [-0.140%; +0.140%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [42.270ns; 44.262ns] or [-2.302%; +2.302%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [76.542ns; 77.808ns] or [-0.820%; +0.820%] None None None

Baseline

Omitted due to size.

@danielsn danielsn merged commit 94fcb08 into main Aug 6, 2024
34 checks passed
@danielsn danielsn deleted the dsn/number-rfc branch August 6, 2024 18:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants