Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

try using an emit_metric macro #649

Draft
wants to merge 50 commits into
base: main
Choose a base branch
from
Draft

Conversation

ajgajg1134
Copy link
Contributor

What does this PR do?

A brief description of the change being made with this pull request.

Motivation

What inspired you to submit this pull request?

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

ajgajg1134 and others added 30 commits September 9, 2024 16:14
Signed-off-by: Bob Weinand <bob.weinand@datadoghq.com>
Signed-off-by: Bob Weinand <bob.weinand@datadoghq.com>
@codecov-commenter
Copy link

Codecov Report

Attention: Patch coverage is 50.00000% with 2 lines in your changes missing coverage. Please review.

Project coverage is 73.66%. Comparing base (cafd312) to head (73a93c7).

Additional details and impacted files
@@                           Coverage Diff                            @@
##           andrew.glaude/dogstatsd-client-SPLIT     #649      +/-   ##
========================================================================
- Coverage                                 73.83%   73.66%   -0.18%     
========================================================================
  Files                                       255      255              
  Lines                                     37079    37116      +37     
========================================================================
- Hits                                      27379    27342      -37     
- Misses                                     9700     9774      +74     
Components Coverage Δ
crashtracker 20.53% <ø> (ø)
datadog-alloc 98.73% <ø> (ø)
data-pipeline 93.39% <50.00%> (+0.06%) ⬆️
data-pipeline-ffi 0.00% <ø> (ø)
ddcommon 83.08% <ø> (ø)
ddcommon-ffi 69.52% <ø> (ø)
ddtelemetry 59.10% <ø> (ø)
dogstatsd-client 78.44% <ø> (ø)
ipc 83.58% <ø> (ø)
profiling 83.57% <ø> (-0.70%) ⬇️
profiling-ffi 77.42% <ø> (ø)
serverless 0.00% <ø> (ø)
sidecar 38.44% <ø> (ø)
sidecar-ffi 0.00% <ø> (ø)
spawn-worker 50.36% <ø> (ø)
tinybytes 94.77% <ø> (ø)
trace-mini-agent 72.47% <ø> (ø)
trace-normalization 98.25% <ø> (ø)
trace-obfuscation 95.73% <ø> (ø)
trace-protobuf 77.67% <ø> (ø)
trace-utils 93.82% <ø> (ø)

@pr-commenter
Copy link

pr-commenter bot commented Sep 24, 2024

Benchmarks

Comparison

Benchmark execution time: 2024-09-24 17:36:30

Comparing candidate commit 73a93c7 in PR branch andrew.glaude/macroTest with baseline commit cafd312 in branch andrew.glaude/dogstatsd-client-SPLIT.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 51 metrics, 2 unstable metrics.

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 73a93c7 1727198761 andrew.glaude/macroTest
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 142.004µs 143.071µs ± 0.421µs 143.078µs ± 0.210µs 143.289µs 143.501µs 144.329µs 145.990µs 2.04% 1.742 11.718 0.29% 0.030µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [143.013µs; 143.130µs] or [-0.041%; +0.041%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 73a93c7 1727198761 andrew.glaude/macroTest
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 2.415µs 2.416µs ± 0.001µs 2.416µs ± 0.001µs 2.417µs 2.418µs 2.421µs 2.426µs 0.43% 3.566 23.398 0.05% 0.000µs 1 200
credit_card/is_card_number/ throughput 412123213.191op/s 413880351.417op/s ± 213767.279op/s 413909913.156op/s ± 115930.004op/s 414027468.707op/s 414080276.068op/s 414125022.286op/s 414155824.053op/s 0.06% -3.547 23.183 0.05% 15115.629op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 98.250µs 99.209µs ± 0.672µs 99.149µs ± 0.363µs 99.432µs 100.185µs 101.747µs 104.901µs 5.80% 3.764 25.873 0.68% 0.048µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 9532770.598op/s 10080211.996op/s ± 66634.319op/s 10085818.836op/s ± 36884.330op/s 10126907.708op/s 10142623.565op/s 10153798.030op/s 10178135.511op/s 0.92% -3.500 22.918 0.66% 4711.758op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 90.737µs 91.890µs ± 0.786µs 91.826µs ± 0.511µs 92.264µs 93.281µs 94.235µs 95.793µs 4.32% 1.294 3.164 0.85% 0.056µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 10439185.138op/s 10883317.234op/s ± 92152.363op/s 10890135.176op/s ± 60313.477op/s 10957575.209op/s 10998441.219op/s 11015898.974op/s 11020902.608op/s 1.20% -1.208 2.740 0.84% 6516.156op/s 1 200
credit_card/is_card_number/37828224631 execution_time 2.415µs 2.416µs ± 0.001µs 2.416µs ± 0.001µs 2.417µs 2.418µs 2.418µs 2.419µs 0.14% 0.956 0.371 0.04% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 413345001.666op/s 413895680.759op/s ± 158744.417op/s 413930361.806op/s ± 99829.989op/s 414024083.018op/s 414080802.171op/s 414098356.840op/s 414105271.983op/s 0.04% -0.954 0.366 0.04% 11224.925op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 86.930µs 88.415µs ± 0.642µs 88.434µs ± 0.423µs 88.812µs 89.370µs 89.989µs 90.512µs 2.35% 0.195 -0.076 0.72% 0.045µs 1 200
credit_card/is_card_number/378282246310005 throughput 11048269.597op/s 11310908.036op/s ± 82058.392op/s 11307880.510op/s ± 54150.986op/s 11367086.630op/s 11439097.428op/s 11489699.967op/s 11503536.676op/s 1.73% -0.155 -0.118 0.72% 5802.405op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 85.767µs 86.163µs ± 0.169µs 86.152µs ± 0.114µs 86.282µs 86.426µs 86.522µs 86.540µs 0.45% -0.096 -0.394 0.20% 0.012µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 11555308.688op/s 11605909.781op/s ± 22800.362op/s 11607338.162op/s ± 15299.053op/s 11618603.162op/s 11644619.505op/s 11654720.917op/s 11659499.592op/s 0.45% 0.105 -0.393 0.20% 1612.229op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 21.249µs 21.792µs ± 0.297µs 21.761µs ± 0.194µs 21.954µs 22.360µs 22.557µs 22.714µs 4.38% 0.669 0.098 1.36% 0.021µs 1 200
credit_card/is_card_number/x371413321323331 throughput 44025428.090op/s 45897823.650op/s ± 620393.595op/s 45953087.335op/s ± 412544.308op/s 46365564.761op/s 46783865.148op/s 46958825.555op/s 47061250.474op/s 2.41% -0.602 -0.020 1.35% 43868.452op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 2.415µs 2.416µs ± 0.001µs 2.416µs ± 0.001µs 2.417µs 2.418µs 2.418µs 2.421µs 0.23% 1.469 4.553 0.04% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 412988039.810op/s 413893834.042op/s ± 156897.027op/s 413926491.296op/s ± 105703.039op/s 414020210.768op/s 414072196.064op/s 414091765.483op/s 414099761.725op/s 0.04% -1.464 4.518 0.04% 11094.295op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 82.172µs 83.248µs ± 0.440µs 83.263µs ± 0.250µs 83.467µs 83.696µs 84.211µs 86.141µs 3.46% 2.306 14.784 0.53% 0.031µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 11608915.033op/s 12012653.200op/s ± 62808.392op/s 12010150.279op/s ± 36158.721op/s 12048949.205op/s 12102216.306op/s 12134623.785op/s 12169618.738op/s 1.33% -2.130 13.529 0.52% 4441.224op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 75.060µs 76.474µs ± 0.642µs 76.461µs ± 0.420µs 76.857µs 77.637µs 78.141µs 78.435µs 2.58% 0.358 0.093 0.84% 0.045µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 12749409.099op/s 13077320.693op/s ± 109464.821op/s 13078646.531op/s ± 71835.651op/s 13153319.614op/s 13247504.407op/s 13295463.787op/s 13322711.776op/s 1.87% -0.309 0.035 0.83% 7740.332op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 2.415µs 2.416µs ± 0.003µs 2.416µs ± 0.001µs 2.417µs 2.418µs 2.419µs 2.454µs 1.58% 12.428 165.396 0.12% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 407430572.905op/s 413832280.375op/s ± 474336.681op/s 413862069.541op/s ± 104910.316op/s 413977310.265op/s 414050789.016op/s 414065029.764op/s 414094251.613op/s 0.06% -12.383 164.578 0.11% 33540.668op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 70.558µs 72.068µs ± 0.478µs 72.094µs ± 0.289µs 72.378µs 72.725µs 73.184µs 73.689µs 2.21% -0.259 0.653 0.66% 0.034µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 13570466.993op/s 13876388.660op/s ± 92260.621op/s 13870844.878op/s ± 55585.806op/s 13928125.063op/s 14053083.440op/s 14093097.273op/s 14172799.461op/s 2.18% 0.310 0.640 0.66% 6523.811op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 85.697µs 86.173µs ± 0.190µs 86.162µs ± 0.139µs 86.318µs 86.504µs 86.559µs 86.587µs 0.49% 0.016 -0.486 0.22% 0.013µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 11549112.007op/s 11604629.527op/s ± 25560.043op/s 11606062.876op/s ± 18777.301op/s 11622707.831op/s 11646199.627op/s 11659628.267op/s 11668982.677op/s 0.54% -0.006 -0.483 0.22% 1807.368op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 21.241µs 21.724µs ± 0.237µs 21.655µs ± 0.143µs 21.866µs 22.177µs 22.270µs 22.571µs 4.23% 0.776 0.230 1.09% 0.017µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 44304582.980op/s 46036433.180op/s ± 498044.621op/s 46179580.052op/s ± 305386.214op/s 46384117.690op/s 46645364.123op/s 46897085.130op/s 47079556.432op/s 1.95% -0.724 0.123 1.08% 35217.073op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [2.416µs; 2.416µs] or [-0.007%; +0.007%] None None None
credit_card/is_card_number/ throughput [413850725.327op/s; 413909977.506op/s] or [-0.007%; +0.007%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [99.116µs; 99.302µs] or [-0.094%; +0.094%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [10070977.120op/s; 10089446.871op/s] or [-0.092%; +0.092%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [91.781µs; 91.999µs] or [-0.119%; +0.119%] None None None
credit_card/is_card_number/ 378282246310005 throughput [10870545.803op/s; 10896088.665op/s] or [-0.117%; +0.117%] None None None
credit_card/is_card_number/37828224631 execution_time [2.416µs; 2.416µs] or [-0.005%; +0.005%] None None None
credit_card/is_card_number/37828224631 throughput [413873680.309op/s; 413917681.208op/s] or [-0.005%; +0.005%] None None None
credit_card/is_card_number/378282246310005 execution_time [88.326µs; 88.504µs] or [-0.101%; +0.101%] None None None
credit_card/is_card_number/378282246310005 throughput [11299535.532op/s; 11322280.540op/s] or [-0.101%; +0.101%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [86.140µs; 86.187µs] or [-0.027%; +0.027%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [11602749.870op/s; 11609069.692op/s] or [-0.027%; +0.027%] None None None
credit_card/is_card_number/x371413321323331 execution_time [21.750µs; 21.833µs] or [-0.189%; +0.189%] None None None
credit_card/is_card_number/x371413321323331 throughput [45811843.065op/s; 45983804.236op/s] or [-0.187%; +0.187%] None None None
credit_card/is_card_number_no_luhn/ execution_time [2.416µs; 2.416µs] or [-0.005%; +0.005%] None None None
credit_card/is_card_number_no_luhn/ throughput [413872089.623op/s; 413915578.461op/s] or [-0.005%; +0.005%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [83.187µs; 83.309µs] or [-0.073%; +0.073%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [12003948.561op/s; 12021357.839op/s] or [-0.072%; +0.072%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [76.385µs; 76.563µs] or [-0.116%; +0.116%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [13062149.922op/s; 13092491.464op/s] or [-0.116%; +0.116%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [2.416µs; 2.417µs] or [-0.016%; +0.016%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [413766541.873op/s; 413898018.877op/s] or [-0.016%; +0.016%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [72.002µs; 72.134µs] or [-0.092%; +0.092%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [13863602.225op/s; 13889175.095op/s] or [-0.092%; +0.092%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [86.147µs; 86.199µs] or [-0.031%; +0.031%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [11601087.150op/s; 11608171.903op/s] or [-0.031%; +0.031%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [21.692µs; 21.757µs] or [-0.151%; +0.151%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [45967408.986op/s; 46105457.375op/s] or [-0.150%; +0.150%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 73a93c7 1727198761 andrew.glaude/macroTest
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 616.532µs 617.596µs ± 0.564µs 617.481µs ± 0.221µs 617.718µs 618.755µs 619.317µs 620.486µs 0.49% 1.903 5.151 0.09% 0.040µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1611638.869op/s 1619182.664op/s ± 1476.568op/s 1619483.990op/s ± 579.154op/s 1620049.648op/s 1620822.889op/s 1621220.919op/s 1621975.826op/s 0.15% -1.893 5.100 0.09% 104.409op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 460.651µs 461.275µs ± 0.253µs 461.269µs ± 0.175µs 461.438µs 461.736µs 461.944µs 461.956µs 0.15% 0.415 0.111 0.05% 0.018µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2164707.587op/s 2167902.569op/s ± 1187.339op/s 2167934.604op/s ± 820.698op/s 2168772.445op/s 2169686.165op/s 2170412.726op/s 2170842.072op/s 0.13% -0.411 0.109 0.05% 83.958op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 178.926µs 179.334µs ± 0.798µs 179.161µs ± 0.067µs 179.222µs 179.647µs 183.145µs 183.770µs 2.57% 4.363 17.810 0.44% 0.056µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5441594.700op/s 5576295.566op/s ± 24341.124op/s 5581558.585op/s ± 2074.755op/s 5583832.032op/s 5585719.082op/s 5586016.231op/s 5588908.008op/s 0.13% -4.353 17.723 0.44% 1721.177op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 45.948µs 46.094µs ± 0.055µs 46.097µs ± 0.037µs 46.132µs 46.177µs 46.218µs 46.271µs 0.38% -0.089 0.037 0.12% 0.004µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 21611887.082op/s 21694947.701op/s ± 25701.079op/s 21693589.726op/s ± 17458.723op/s 21711089.694op/s 21739101.521op/s 21753069.101op/s 21763504.369op/s 0.32% 0.096 0.034 0.12% 1817.341op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 48.882µs 48.961µs ± 0.102µs 48.943µs ± 0.007µs 48.950µs 49.012µs 49.361µs 50.039µs 2.24% 7.690 68.918 0.21% 0.007µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 19984279.034op/s 20424333.471op/s ± 42061.452op/s 20432055.782op/s ± 2797.138op/s 20434388.116op/s 20438725.705op/s 20456630.845op/s 20457312.643op/s 0.12% -7.617 67.689 0.21% 2974.194op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [617.518µs; 617.674µs] or [-0.013%; +0.013%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1618978.026op/s; 1619387.302op/s] or [-0.013%; +0.013%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [461.240µs; 461.311µs] or [-0.008%; +0.008%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2167738.015op/s; 2168067.122op/s] or [-0.008%; +0.008%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [179.223µs; 179.445µs] or [-0.062%; +0.062%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5572922.121op/s; 5579669.012op/s] or [-0.060%; +0.060%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [46.086µs; 46.101µs] or [-0.016%; +0.016%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [21691385.779op/s; 21698509.624op/s] or [-0.016%; +0.016%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [48.947µs; 48.976µs] or [-0.029%; +0.029%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [20418504.159op/s; 20430162.784op/s] or [-0.029%; +0.029%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 73a93c7 1727198761 andrew.glaude/macroTest
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 75.450µs 75.644µs ± 0.175µs 75.625µs ± 0.054µs 75.680µs 75.745µs 76.538µs 77.310µs 2.23% 6.356 50.767 0.23% 0.012µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [75.620µs; 75.668µs] or [-0.032%; +0.032%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 73a93c7 1727198761 andrew.glaude/macroTest
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 252.717µs 257.263µs ± 2.093µs 257.138µs ± 1.388µs 258.722µs 260.609µs 261.496µs 262.428µs 2.06% -0.002 -0.557 0.81% 0.148µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 3810569.463op/s 3887335.862op/s ± 31635.395op/s 3888968.954op/s ± 20877.365op/s 3907542.021op/s 3944459.944op/s 3949149.277op/s 3956995.374op/s 1.75% 0.037 -0.555 0.81% 2236.960op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 23.363µs 23.522µs ± 0.066µs 23.516µs ± 0.040µs 23.562µs 23.642µs 23.659µs 23.713µs 0.84% 0.139 -0.024 0.28% 0.005µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 42170330.566op/s 42513662.269op/s ± 120020.748op/s 42523844.286op/s ± 73056.427op/s 42590674.584op/s 42706284.867op/s 42793530.562op/s 42801856.200op/s 0.65% -0.123 -0.025 0.28% 8486.748op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 13.944µs 14.043µs ± 0.069µs 14.031µs ± 0.035µs 14.072µs 14.134µs 14.206µs 14.680µs 4.62% 4.288 35.039 0.49% 0.005µs 1 200
normalization/normalize_name/normalize_name/good throughput 68120283.653op/s 71211830.737op/s ± 342735.978op/s 71268706.324op/s ± 176068.693op/s 71417672.389op/s 71573494.051op/s 71694190.544op/s 71717688.285op/s 0.63% -4.025 31.788 0.48% 24235.093op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [256.972µs; 257.553µs] or [-0.113%; +0.113%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [3882951.500op/s; 3891720.223op/s] or [-0.113%; +0.113%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [23.513µs; 23.531µs] or [-0.039%; +0.039%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [42497028.547op/s; 42530295.990op/s] or [-0.039%; +0.039%] None None None
normalization/normalize_name/normalize_name/good execution_time [14.033µs; 14.052µs] or [-0.068%; +0.068%] None None None
normalization/normalize_name/normalize_name/good throughput [71164330.827op/s; 71259330.647op/s] or [-0.067%; +0.067%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 73a93c7 1727198761 andrew.glaude/macroTest
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 9.132ms 9.170ms ± 0.017ms 9.169ms ± 0.008ms 9.177ms 9.190ms 9.197ms 9.334ms 1.80% 4.770 46.497 0.18% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [9.167ms; 9.172ms] or [-0.025%; +0.025%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 73a93c7 1727198761 andrew.glaude/macroTest
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.656µs 2.709µs ± 0.016µs 2.710µs ± 0.006µs 2.715µs 2.737µs 2.742µs 2.745µs 1.32% -0.863 2.281 0.59% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.707µs; 2.711µs] or [-0.083%; +0.083%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 73a93c7 1727198761 andrew.glaude/macroTest
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 1.124µs 1.183µs ± 0.021µs 1.188µs ± 0.013µs 1.200µs 1.203µs 1.204µs 1.204µs 1.38% -1.239 0.805 1.78% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [1.180µs; 1.185µs] or [-0.247%; +0.247%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 73a93c7 1727198761 andrew.glaude/macroTest
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.219µs 26.248µs ± 10.618µs 18.605µs ± 0.824µs 34.803µs 41.989µs 45.282µs 91.282µs 390.63% 1.857 7.282 40.35% 0.751µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [24.777µs; 27.720µs] or [-5.606%; +5.606%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 73a93c7 1727198761 andrew.glaude/macroTest
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 273.015ns 285.049ns ± 13.850ns 280.480ns ± 5.718ns 287.477ns 314.911ns 331.017ns 333.619ns 18.95% 1.806 2.874 4.85% 0.979ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [283.130ns; 286.969ns] or [-0.673%; +0.673%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 73a93c7 1727198761 andrew.glaude/macroTest
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.352µs 3.186µs ± 1.538µs 3.033µs ± 0.022µs 3.053µs 3.143µs 13.772µs 17.585µs 479.88% 7.945 63.755 48.15% 0.109µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [2.973µs; 3.400µs] or [-6.690%; +6.690%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 73a93c7 1727198761 andrew.glaude/macroTest
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 39.314µs 39.879µs ± 0.901µs 39.475µs ± 0.065µs 39.568µs 41.792µs 41.815µs 42.949µs 8.80% 1.716 1.124 2.25% 0.064µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [39.754µs; 40.004µs] or [-0.313%; +0.313%] None None None

Baseline

Omitted due to size.

Base automatically changed from andrew.glaude/dogstatsd-client-SPLIT to main September 24, 2024 19:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants