Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[crashtracker] Build static binary #581

Merged
merged 2 commits into from
Aug 6, 2024
Merged

Conversation

danielsn
Copy link
Contributor

@danielsn danielsn commented Aug 6, 2024

What does this PR do?

Builds a static binary for the crashtracker

Motivation

Request from Node.

Additional Notes

The binary is statically linked, and hence much larger than the dynamically linked C binary we currently generate. If possible, using that one will save binary size.

How to test the change?

Describe here in detail how the change can be validated.

@danielsn danielsn requested a review from a team as a code owner August 6, 2024 19:27
@codecov-commenter
Copy link

codecov-commenter commented Aug 6, 2024

Codecov Report

Attention: Patch coverage is 0% with 3 lines in your changes missing coverage. Please review.

Project coverage is 71.26%. Comparing base (94fcb08) to head (a2103c2).
Report is 63 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #581      +/-   ##
==========================================
- Coverage   71.27%   71.26%   -0.01%     
==========================================
  Files         219      220       +1     
  Lines       29918    29921       +3     
==========================================
  Hits        21323    21323              
- Misses       8595     8598       +3     
Components Coverage Δ
crashtracker 21.17% <0.00%> (-0.04%) ⬇️
datadog-alloc 98.73% <ø> (ø)
data-pipeline 50.00% <ø> (ø)
data-pipeline-ffi 0.00% <ø> (ø)
ddcommon 83.07% <ø> (ø)
ddcommon-ffi 70.20% <ø> (ø)
ddtelemetry 58.95% <ø> (ø)
ipc 84.18% <ø> (ø)
profiling 84.26% <ø> (ø)
profiling-ffi 77.42% <ø> (ø)
serverless 0.00% <ø> (ø)
sidecar 34.55% <ø> (ø)
sidecar-ffi 0.00% <ø> (ø)
spawn-worker 54.87% <ø> (ø)
trace-mini-agent 70.88% <ø> (ø)
trace-normalization 98.24% <ø> (ø)
trace-obfuscation 95.73% <ø> (ø)
trace-protobuf 77.16% <ø> (ø)
trace-utils 92.96% <ø> (ø)

@danielsn danielsn requested a review from a team as a code owner August 6, 2024 20:21
@pr-commenter
Copy link

pr-commenter bot commented Aug 6, 2024

Benchmarks

Comparison

Benchmark execution time: 2024-08-06 20:35:04

Comparing candidate commit a2103c2 in PR branch dsn/crashtracker-cargo-binary with baseline commit 94fcb08 in branch main.

Found 1 performance improvements and 4 performance regressions! Performance is the same for 37 metrics, 2 unstable metrics.

scenario:credit_card/is_card_number/37828224631000521389798

  • 🟥 execution_time [+10.505ns; +10.687ns] or [+15.454%; +15.722%]
  • 🟥 throughput [-2001620.721op/s; -1966926.379op/s] or [-13.605%; -13.369%]

scenario:credit_card/is_card_number_no_luhn/ 378282246310005

  • 🟥 execution_time [+11.210ns; +11.587ns] or [+17.424%; +18.010%]
  • 🟥 throughput [-2372242.406op/s; -2301604.492op/s] or [-15.261%; -14.807%]

scenario:tags/replace_trace_tags

  • 🟩 execution_time [-50.514ns; -49.057ns] or [-2.171%; -2.109%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a2103c2 1722975672 dsn/crashtracker-cargo-binary
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 321.552ns 330.471ns ± 6.224ns 330.415ns ± 5.259ns 335.177ns 339.129ns 346.939ns 355.642ns 7.64% 0.672 0.881 1.88% 0.440ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [329.609ns; 331.334ns] or [-0.261%; +0.261%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a2103c2 1722975672 dsn/crashtracker-cargo-binary
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 67.628µs 67.814µs ± 0.135µs 67.784µs ± 0.045µs 67.845µs 67.938µs 68.147µs 69.298µs 2.23% 7.182 72.846 0.20% 0.010µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [67.795µs; 67.832µs] or [-0.028%; +0.028%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a2103c2 1722975672 dsn/crashtracker-cargo-binary
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 133.881µs 134.211µs ± 0.160µs 134.194µs ± 0.097µs 134.297µs 134.443µs 134.716µs 134.789µs 0.44% 0.630 1.115 0.12% 0.011µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [134.189µs; 134.233µs] or [-0.017%; +0.017%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a2103c2 1722975672 dsn/crashtracker-cargo-binary
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.655µs 38.897µs ± 34.506µs 37.716µs ± 2.786µs 40.642µs 50.725µs 60.147µs 499.092µs 1223.30% 11.983 156.939 88.49% 2.440µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [34.115µs; 43.679µs] or [-12.295%; +12.295%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a2103c2 1722975672 dsn/crashtracker-cargo-binary
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 1.354µs 1.355µs ± 0.000µs 1.355µs ± 0.000µs 1.356µs 1.356µs 1.357µs 1.358µs 0.22% 1.729 10.545 0.04% 0.000µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [1.355µs; 1.355µs] or [-0.005%; +0.005%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a2103c2 1722975672 dsn/crashtracker-cargo-binary
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 35.726µs 35.808µs ± 0.092µs 35.788µs ± 0.019µs 35.817µs 35.910µs 36.033µs 36.894µs 3.09% 8.509 94.506 0.26% 0.007µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [35.796µs; 35.821µs] or [-0.036%; +0.036%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a2103c2 1722975672 dsn/crashtracker-cargo-binary
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.268µs 2.277µs ± 0.004µs 2.277µs ± 0.002µs 2.279µs 2.283µs 2.284µs 2.285µs 0.34% -0.370 -0.381 0.17% 0.000µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.276µs; 2.277µs] or [-0.024%; +0.024%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a2103c2 1722975672 dsn/crashtracker-cargo-binary
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 2.005µs 3.038µs ± 1.893µs 2.841µs ± 0.019µs 2.855µs 3.268µs 4.458µs 25.335µs 791.61% 10.320 109.834 62.16% 0.134µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [2.776µs; 3.300µs] or [-8.636%; +8.636%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a2103c2 1722975672 dsn/crashtracker-cargo-binary
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 265.688ns 272.008ns ± 3.784ns 271.818ns ± 2.427ns 273.873ns 278.839ns 283.609ns 285.766ns 5.13% 1.004 1.423 1.39% 0.268ns 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 34.024ns 35.372ns ± 0.560ns 35.260ns ± 0.204ns 35.495ns 36.537ns 37.222ns 37.223ns 5.57% 1.346 2.751 1.58% 0.040ns 1 200
normalization/normalize_name/normalize_name/good execution_time 24.306ns 25.402ns ± 0.366ns 25.361ns ± 0.248ns 25.672ns 26.012ns 26.065ns 26.399ns 4.09% 0.038 -0.300 1.44% 0.026ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [271.484ns; 272.532ns] or [-0.193%; +0.193%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [35.295ns; 35.450ns] or [-0.219%; +0.219%] None None None
normalization/normalize_name/normalize_name/good execution_time [25.352ns; 25.453ns] or [-0.200%; +0.200%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a2103c2 1722975672 dsn/crashtracker-cargo-binary
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.424ns 3.591ns ± 0.024ns 3.599ns ± 0.004ns 3.602ns 3.604ns 3.605ns 3.612ns 0.36% -4.048 18.885 0.68% 0.002ns 1 200
credit_card/is_card_number/ throughput 276858825.743op/s 278515819.589op/s ± 1952741.272op/s 277867088.079op/s ± 291821.772op/s 278589172.586op/s 280920057.883op/s 288000438.782op/s 292072892.554op/s 5.11% 4.142 19.792 0.70% 138079.660op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 85.438ns 87.161ns ± 0.802ns 87.121ns ± 0.470ns 87.546ns 88.669ns 89.568ns 90.224ns 3.56% 0.809 1.322 0.92% 0.057ns 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 11083557.676op/s 11473989.041op/s ± 104832.499op/s 11478315.361op/s ± 61860.516op/s 11545752.001op/s 11624875.711op/s 11680065.163op/s 11704343.117op/s 1.97% -0.737 1.158 0.91% 7412.777op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 80.892ns 82.687ns ± 0.698ns 82.652ns ± 0.441ns 83.084ns 83.946ns 84.516ns 84.965ns 2.80% 0.450 0.597 0.84% 0.049ns 1 200
credit_card/is_card_number/ 378282246310005 throughput 11769572.167op/s 12094670.367op/s ± 101680.961op/s 12098885.065op/s ± 64501.212op/s 12163195.732op/s 12238852.529op/s 12337715.537op/s 12362107.414op/s 2.18% -0.390 0.529 0.84% 7189.930op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.460ns 3.596ns ± 0.017ns 3.600ns ± 0.002ns 3.602ns 3.603ns 3.606ns 3.694ns 2.61% -3.123 31.085 0.46% 0.001ns 1 200
credit_card/is_card_number/37828224631 throughput 270689878.881op/s 278090967.335op/s ± 1316244.075op/s 277761068.007op/s ± 181692.639op/s 278148476.758op/s 279363646.303op/s 283400395.096op/s 289030723.436op/s 4.06% 3.445 32.372 0.47% 93072.511op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 77.402ns 80.159ns ± 0.646ns 80.163ns ± 0.389ns 80.560ns 81.154ns 81.688ns 81.825ns 2.07% -0.626 2.539 0.80% 0.046ns 1 200
credit_card/is_card_number/378282246310005 throughput 12221231.912op/s 12475980.906op/s ± 101033.433op/s 12474549.770op/s ± 60275.091op/s 12532048.544op/s 12614494.704op/s 12801501.953op/s 12919492.545op/s 3.57% 0.728 2.835 0.81% 7144.143op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 77.400ns 78.570ns ± 0.449ns 78.553ns ± 0.267ns 78.819ns 79.261ns 79.652ns 80.777ns 2.83% 0.657 2.407 0.57% 0.032ns 1 200
credit_card/is_card_number/37828224631000521389798 throughput 12379745.799op/s 12727930.248op/s ± 72440.414op/s 12730276.123op/s ± 43046.158op/s 12772434.744op/s 12830364.473op/s 12890422.914op/s 12919931.037op/s 1.49% -0.591 2.179 0.57% 5122.311op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 21.378ns 22.431ns ± 0.450ns 22.410ns ± 0.268ns 22.681ns 23.216ns 23.588ns 23.767ns 6.05% 0.290 0.068 2.00% 0.032ns 1 200
credit_card/is_card_number/x371413321323331 throughput 42075689.489op/s 44599888.282op/s ± 890909.756op/s 44622787.283op/s ± 529605.313op/s 45129481.584op/s 46091136.920op/s 46657707.648op/s 46776470.787op/s 4.83% -0.172 -0.004 1.99% 62996.833op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.266ns 3.429ns ± 0.016ns 3.431ns ± 0.000ns 3.431ns 3.433ns 3.434ns 3.444ns 0.39% -9.730 93.562 0.47% 0.001ns 1 200
credit_card/is_card_number_no_luhn/ throughput 290362337.196op/s 291627056.079op/s ± 1448778.936op/s 291493654.261op/s ± 42467.445op/s 291534397.723op/s 291613793.520op/s 291977067.722op/s 306229330.946op/s 5.06% 9.742 93.724 0.50% 102444.141op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 66.606ns 68.998ns ± 0.508ns 68.988ns ± 0.269ns 69.307ns 69.817ns 70.307ns 70.937ns 2.82% -0.251 3.689 0.73% 0.036ns 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 14097092.638op/s 14493876.143op/s ± 106863.874op/s 14495333.127op/s ± 56287.552op/s 14547800.832op/s 14652820.662op/s 14824952.739op/s 15013704.224op/s 3.58% 0.377 3.921 0.74% 7556.417op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 72.130ns 75.737ns ± 1.240ns 75.745ns ± 0.775ns 76.484ns 77.919ns 78.441ns 78.910ns 4.18% -0.051 0.203 1.63% 0.088ns 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 12672722.884op/s 13207124.480op/s ± 216579.463op/s 13202142.646op/s ± 134899.090op/s 13344838.215op/s 13569043.657op/s 13746613.852op/s 13863925.943op/s 5.01% 0.160 0.278 1.64% 15314.481op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.265ns 3.429ns ± 0.016ns 3.431ns ± 0.000ns 3.431ns 3.432ns 3.434ns 3.440ns 0.26% -9.761 93.953 0.47% 0.001ns 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 290729146.534op/s 291627224.461op/s ± 1450101.267op/s 291493535.277op/s ± 40497.640op/s 291525113.716op/s 291621887.195op/s 291972151.133op/s 306277193.427op/s 5.07% 9.771 94.082 0.50% 102537.644op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 60.002ns 61.922ns ± 0.497ns 61.910ns ± 0.324ns 62.248ns 62.695ns 62.932ns 63.044ns 1.83% -0.456 0.975 0.80% 0.035ns 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 15861872.650op/s 16150467.859op/s ± 130040.533op/s 16152486.800op/s ± 84565.802op/s 16232150.689op/s 16348983.129op/s 16555162.385op/s 16666056.163op/s 3.18% 0.523 1.139 0.80% 9195.254op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 66.310ns 67.830ns ± 0.804ns 67.763ns ± 0.220ns 67.983ns 68.408ns 72.000ns 75.448ns 11.34% 6.187 49.642 1.18% 0.057ns 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 13254222.344op/s 14744755.458op/s ± 163284.349op/s 14757210.608op/s ± 47906.733op/s 14804821.929op/s 14879896.962op/s 14990076.810op/s 15080764.111op/s 2.19% -5.729 44.165 1.10% 11545.947op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 20.802ns 22.246ns ± 0.478ns 22.208ns ± 0.235ns 22.470ns 22.878ns 24.003ns 24.329ns 9.55% 1.113 3.989 2.14% 0.034ns 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 41102690.937op/s 44972772.662op/s ± 947286.367op/s 45027859.703op/s ± 481583.474op/s 45486595.546op/s 46441844.153op/s 47055832.980op/s 48071841.367op/s 6.76% -0.818 3.203 2.10% 66983.261op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.587ns; 3.594ns] or [-0.094%; +0.094%] None None None
credit_card/is_card_number/ throughput [278245188.429op/s; 278786450.749op/s] or [-0.097%; +0.097%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [87.050ns; 87.272ns] or [-0.128%; +0.128%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [11459460.265op/s; 11488517.817op/s] or [-0.127%; +0.127%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [82.590ns; 82.784ns] or [-0.117%; +0.117%] None None None
credit_card/is_card_number/ 378282246310005 throughput [12080578.363op/s; 12108762.370op/s] or [-0.117%; +0.117%] None None None
credit_card/is_card_number/37828224631 execution_time [3.594ns; 3.598ns] or [-0.065%; +0.065%] None None None
credit_card/is_card_number/37828224631 throughput [277908548.566op/s; 278273386.105op/s] or [-0.066%; +0.066%] None None None
credit_card/is_card_number/378282246310005 execution_time [80.070ns; 80.249ns] or [-0.112%; +0.112%] None None None
credit_card/is_card_number/378282246310005 throughput [12461978.644op/s; 12489983.168op/s] or [-0.112%; +0.112%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [78.508ns; 78.632ns] or [-0.079%; +0.079%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [12717890.703op/s; 12737969.792op/s] or [-0.079%; +0.079%] None None None
credit_card/is_card_number/x371413321323331 execution_time [22.368ns; 22.493ns] or [-0.278%; +0.278%] None None None
credit_card/is_card_number/x371413321323331 throughput [44476416.758op/s; 44723359.806op/s] or [-0.277%; +0.277%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.427ns; 3.431ns] or [-0.066%; +0.066%] None None None
credit_card/is_card_number_no_luhn/ throughput [291426269.252op/s; 291827842.906op/s] or [-0.069%; +0.069%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [68.928ns; 69.069ns] or [-0.102%; +0.102%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [14479065.838op/s; 14508686.448op/s] or [-0.102%; +0.102%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [75.565ns; 75.909ns] or [-0.227%; +0.227%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [13177108.649op/s; 13237140.310op/s] or [-0.227%; +0.227%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.427ns; 3.431ns] or [-0.066%; +0.066%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [291426254.371op/s; 291828194.550op/s] or [-0.069%; +0.069%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [61.853ns; 61.991ns] or [-0.111%; +0.111%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [16132445.492op/s; 16168490.226op/s] or [-0.112%; +0.112%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [67.718ns; 67.941ns] or [-0.164%; +0.164%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [14722125.818op/s; 14767385.099op/s] or [-0.153%; +0.153%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [22.179ns; 22.312ns] or [-0.298%; +0.298%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [44841487.882op/s; 45104057.442op/s] or [-0.292%; +0.292%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz a2103c2 1722975672 dsn/crashtracker-cargo-binary
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 655.639ns 657.569ns ± 0.541ns 657.525ns ± 0.222ns 657.798ns 658.194ns 659.499ns 660.990ns 0.53% 1.710 11.569 0.08% 0.038ns 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 444.048ns 447.749ns ± 2.127ns 447.424ns ± 0.425ns 447.996ns 450.483ns 452.474ns 473.034ns 5.72% 8.710 98.673 0.47% 0.150ns 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 229.586ns 232.731ns ± 2.333ns 234.138ns ± 1.380ns 234.763ns 235.489ns 236.445ns 237.079ns 1.26% -0.124 -1.782 1.00% 0.165ns 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 37.002ns 43.242ns ± 7.120ns 39.833ns ± 2.175ns 46.357ns 58.881ns 59.112ns 59.318ns 48.92% 1.355 0.477 16.42% 0.503ns 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 72.370ns 77.107ns ± 4.634ns 75.358ns ± 0.500ns 83.968ns 85.036ns 85.462ns 85.923ns 14.02% 0.911 -0.825 6.00% 0.328ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [657.494ns; 657.644ns] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [447.454ns; 448.044ns] or [-0.066%; +0.066%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [232.408ns; 233.055ns] or [-0.139%; +0.139%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [42.256ns; 44.229ns] or [-2.282%; +2.282%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [76.465ns; 77.750ns] or [-0.833%; +0.833%] None None None

Baseline

Omitted due to size.

@danielsn danielsn merged commit 66b83a6 into main Aug 6, 2024
34 checks passed
@danielsn danielsn deleted the dsn/crashtracker-cargo-binary branch August 6, 2024 20:48
hoolioh pushed a commit that referenced this pull request Aug 21, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants