Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add data-pipeline-ffi to nuget artifacts #650

Draft
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

ajgajg1134
Copy link
Contributor

What does this PR do?

A brief description of the change being made with this pull request.

Motivation

What inspired you to submit this pull request?

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

@codecov-commenter
Copy link

codecov-commenter commented Sep 25, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 73.77%. Comparing base (bc58fa5) to head (2711241).
Report is 4 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #650      +/-   ##
==========================================
- Coverage   73.81%   73.77%   -0.04%     
==========================================
  Files         257      257              
  Lines       37309    37329      +20     
==========================================
  Hits        27541    27541              
- Misses       9768     9788      +20     
Components Coverage Δ
crashtracker 20.36% <ø> (-0.12%) ⬇️
datadog-alloc 98.73% <ø> (ø)
data-pipeline 93.33% <ø> (+0.27%) ⬆️
data-pipeline-ffi 0.00% <ø> (ø)
ddcommon 83.08% <ø> (ø)
ddcommon-ffi 69.52% <ø> (ø)
ddtelemetry 59.10% <ø> (ø)
dogstatsd-client 79.77% <ø> (ø)
ipc 83.58% <ø> (ø)
profiling 84.26% <ø> (ø)
profiling-ffi 77.42% <ø> (ø)
serverless 0.00% <ø> (ø)
sidecar 38.19% <ø> (ø)
sidecar-ffi 0.00% <ø> (ø)
spawn-worker 50.36% <ø> (ø)
tinybytes 94.77% <ø> (ø)
trace-mini-agent 72.47% <ø> (ø)
trace-normalization 98.25% <ø> (ø)
trace-obfuscation 95.73% <ø> (ø)
trace-protobuf 77.67% <ø> (ø)
trace-utils 93.46% <ø> (-0.41%) ⬇️

@pr-commenter
Copy link

pr-commenter bot commented Sep 25, 2024

Benchmarks

Comparison

Benchmark execution time: 2024-10-01 15:16:35

Comparing candidate commit 2711241 in PR branch andrew.glaude/NET-tracer with baseline commit dcf22a9 in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 51 metrics, 2 unstable metrics.

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2711241 1727795175 andrew.glaude/NET-tracer
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.722µs 2.760µs ± 0.014µs 2.759µs ± 0.011µs 2.771µs 2.784µs 2.786µs 2.788µs 1.08% -0.069 -0.742 0.52% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.758µs; 2.762µs] or [-0.072%; +0.072%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2711241 1727795175 andrew.glaude/NET-tracer
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 19.482µs 26.854µs ± 10.507µs 21.807µs ± 0.349µs 36.538µs 39.635µs 41.059µs 110.714µs 407.69% 3.893 24.289 39.03% 0.743µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [25.397µs; 28.310µs] or [-5.423%; +5.423%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2711241 1727795175 andrew.glaude/NET-tracer
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 140.628µs 141.879µs ± 0.400µs 141.900µs ± 0.182µs 142.041µs 142.377µs 143.132µs 144.561µs 1.88% 1.568 10.311 0.28% 0.028µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [141.823µs; 141.934µs] or [-0.039%; +0.039%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2711241 1727795175 andrew.glaude/NET-tracer
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.395µs 3.197µs ± 1.550µs 3.042µs ± 0.024µs 3.061µs 3.144µs 13.887µs 17.660µs 480.53% 7.944 63.637 48.36% 0.110µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [2.982µs; 3.411µs] or [-6.719%; +6.719%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2711241 1727795175 andrew.glaude/NET-tracer
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 318.126µs 318.447µs ± 0.151µs 318.433µs ± 0.095µs 318.542µs 318.729µs 318.838µs 318.884µs 0.14% 0.402 -0.149 0.05% 0.011µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 3135932.418op/s 3140240.342op/s ± 1489.252op/s 3140378.229op/s ± 940.490op/s 3141255.336op/s 3142425.505op/s 3143057.523op/s 3143409.727op/s 0.10% -0.400 -0.152 0.05% 105.306op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 29.290µs 29.362µs ± 0.033µs 29.360µs ± 0.021µs 29.384µs 29.414µs 29.457µs 29.483µs 0.42% 0.376 0.678 0.11% 0.002µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 33917549.401op/s 34057181.766op/s ± 38644.433op/s 34059928.610op/s ± 24822.223op/s 34080064.494op/s 34124447.370op/s 34134965.491op/s 34141673.360op/s 0.24% -0.368 0.662 0.11% 2732.574op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 17.285µs 17.305µs ± 0.029µs 17.289µs ± 0.002µs 17.327µs 17.335µs 17.374µs 17.547µs 1.49% 3.550 24.251 0.16% 0.002µs 1 200
normalization/normalize_name/normalize_name/good throughput 56990215.218op/s 57787645.130op/s ± 94928.749op/s 57841803.656op/s ± 5791.170op/s 57845828.753op/s 57849436.804op/s 57853373.996op/s 57854517.152op/s 0.02% -3.484 23.458 0.16% 6712.476op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [318.426µs; 318.468µs] or [-0.007%; +0.007%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [3140033.946op/s; 3140446.738op/s] or [-0.007%; +0.007%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [29.358µs; 29.367µs] or [-0.016%; +0.016%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [34051826.019op/s; 34062537.512op/s] or [-0.016%; +0.016%] None None None
normalization/normalize_name/normalize_name/good execution_time [17.301µs; 17.309µs] or [-0.023%; +0.023%] None None None
normalization/normalize_name/normalize_name/good throughput [57774488.919op/s; 57800801.342op/s] or [-0.023%; +0.023%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2711241 1727795175 andrew.glaude/NET-tracer
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 2.015µs 2.016µs ± 0.002µs 2.016µs ± 0.001µs 2.017µs 2.018µs 2.019µs 2.040µs 1.16% 9.709 117.152 0.09% 0.000µs 1 200
credit_card/is_card_number/ throughput 490306414.819op/s 495934777.712op/s ± 454477.216op/s 496003794.464op/s ± 134528.901op/s 496129775.151op/s 496216494.294op/s 496280781.274op/s 496290230.527op/s 0.06% -9.640 115.985 0.09% 32136.392op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 111.507µs 112.538µs ± 0.746µs 112.326µs ± 0.383µs 112.849µs 114.060µs 114.451µs 116.186µs 3.44% 1.433 2.492 0.66% 0.053µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 8606866.481op/s 8886261.651op/s ± 58397.519op/s 8902694.848op/s ± 30365.216op/s 8931666.331op/s 8945950.342op/s 8958870.659op/s 8968009.799op/s 0.73% -1.386 2.242 0.66% 4129.328op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 103.566µs 104.338µs ± 0.487µs 104.259µs ± 0.352µs 104.610µs 105.294µs 105.579µs 106.034µs 1.70% 0.809 0.263 0.47% 0.034µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 9430915.937op/s 9584483.560op/s ± 44588.072op/s 9591523.506op/s ± 32252.691op/s 9623429.969op/s 9637037.642op/s 9650402.437op/s 9655657.139op/s 0.67% -0.787 0.205 0.46% 3152.853op/s 1 200
credit_card/is_card_number/37828224631 execution_time 2.015µs 2.016µs ± 0.002µs 2.016µs ± 0.001µs 2.017µs 2.017µs 2.017µs 2.039µs 1.14% 11.909 156.366 0.09% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 490387379.341op/s 495965416.123op/s ± 419027.353op/s 495981162.915op/s ± 125236.858op/s 496117450.941op/s 496190271.896op/s 496219712.016op/s 496270915.703op/s 0.06% -11.866 155.618 0.08% 29629.708op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 99.921µs 100.946µs ± 0.579µs 100.852µs ± 0.342µs 101.242µs 101.822µs 102.505µs 104.124µs 3.24% 1.584 5.368 0.57% 0.041µs 1 200
credit_card/is_card_number/378282246310005 throughput 9603929.113op/s 9906558.738op/s ± 56286.874op/s 9915487.503op/s ± 33630.814op/s 9947210.215op/s 9976973.208op/s 9998211.619op/s 10007897.141op/s 0.93% -1.503 4.888 0.57% 3980.083op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 100.520µs 101.064µs ± 0.549µs 100.947µs ± 0.249µs 101.213µs 102.093µs 103.383µs 103.987µs 3.01% 2.497 8.028 0.54% 0.039µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 9616563.569op/s 9895043.179op/s ± 53084.298op/s 9906169.266op/s ± 24424.105op/s 9928331.856op/s 9946555.912op/s 9948133.189op/s 9948264.053op/s 0.42% -2.436 7.660 0.54% 3753.627op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 20.835µs 20.853µs ± 0.021µs 20.848µs ± 0.007µs 20.854µs 20.893µs 20.923µs 21.009µs 0.77% 3.296 16.897 0.10% 0.001µs 1 200
credit_card/is_card_number/x371413321323331 throughput 47599408.141op/s 47955805.125op/s ± 47383.001op/s 47967250.360op/s ± 16822.525op/s 47984062.095op/s 47992334.664op/s 47994830.237op/s 47996798.614op/s 0.06% -3.272 16.641 0.10% 3350.484op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 2.015µs 2.016µs ± 0.001µs 2.016µs ± 0.001µs 2.017µs 2.018µs 2.018µs 2.019µs 0.13% 0.791 0.007 0.04% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 495413331.533op/s 496008426.406op/s ± 180591.358op/s 496041171.418op/s ± 128576.013op/s 496162443.585op/s 496228466.070op/s 496257649.033op/s 496271808.069op/s 0.05% -0.790 0.003 0.04% 12769.737op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 88.427µs 90.090µs ± 0.819µs 89.967µs ± 0.421µs 90.496µs 91.605µs 92.265µs 93.896µs 4.37% 0.936 2.013 0.91% 0.058µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 10650068.679op/s 11100973.165op/s ± 100075.722op/s 11115235.103op/s ± 52067.081op/s 11162896.784op/s 11249500.582op/s 11293841.681op/s 11308812.703op/s 1.74% -0.853 1.717 0.90% 7076.422op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 80.984µs 81.453µs ± 0.276µs 81.369µs ± 0.055µs 81.455µs 81.998µs 82.411µs 83.471µs 2.58% 3.222 15.597 0.34% 0.020µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 11980249.536op/s 12277211.681op/s ± 41146.831op/s 12289658.867op/s ± 8340.718op/s 12296569.876op/s 12301191.863op/s 12342247.706op/s 12348057.405op/s 0.48% -3.151 14.884 0.33% 2909.520op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 2.015µs 2.016µs ± 0.002µs 2.016µs ± 0.000µs 2.017µs 2.017µs 2.018µs 2.048µs 1.57% 12.535 167.218 0.12% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 488300770.430op/s 495948912.450op/s ± 565133.274op/s 495956787.060op/s ± 113685.054op/s 496130005.871op/s 496195543.990op/s 496219992.921op/s 496269373.295op/s 0.06% -12.493 166.452 0.11% 39960.957op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 77.232µs 77.816µs ± 0.252µs 77.759µs ± 0.059µs 77.842µs 78.241µs 78.846µs 79.100µs 1.72% 1.905 6.240 0.32% 0.018µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 12642304.326op/s 12850986.033op/s ± 41307.678op/s 12860179.739op/s ± 9817.081op/s 12868684.700op/s 12904658.798op/s 12921596.564op/s 12948000.829op/s 0.68% -1.860 6.028 0.32% 2920.894op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 100.511µs 101.100µs ± 0.720µs 100.934µs ± 0.242µs 101.194µs 102.284µs 104.354µs 105.827µs 4.85% 3.346 14.162 0.71% 0.051µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 9449384.373op/s 9891665.164op/s ± 68852.792op/s 9907483.618op/s ± 23851.235op/s 9931010.325op/s 9947249.785op/s 9948655.012op/s 9949189.789op/s 0.42% -3.244 13.294 0.69% 4868.628op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 20.835µs 20.858µs ± 0.038µs 20.849µs ± 0.008µs 20.855µs 20.903µs 20.985µs 21.175µs 1.56% 6.001 43.904 0.18% 0.003µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 47226414.374op/s 47943038.254op/s ± 87238.808op/s 47963405.224op/s ± 17371.318op/s 47980987.108op/s 47989148.962op/s 47992602.735op/s 47995789.998op/s 0.07% -5.947 43.243 0.18% 6168.715op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [2.016µs; 2.017µs] or [-0.013%; +0.013%] None None None
credit_card/is_card_number/ throughput [495871791.541op/s; 495997763.883op/s] or [-0.013%; +0.013%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [112.435µs; 112.642µs] or [-0.092%; +0.092%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [8878168.316op/s; 8894354.985op/s] or [-0.091%; +0.091%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [104.270µs; 104.405µs] or [-0.065%; +0.065%] None None None
credit_card/is_card_number/ 378282246310005 throughput [9578304.082op/s; 9590663.038op/s] or [-0.064%; +0.064%] None None None
credit_card/is_card_number/37828224631 execution_time [2.016µs; 2.017µs] or [-0.012%; +0.012%] None None None
credit_card/is_card_number/37828224631 throughput [495907342.962op/s; 496023489.284op/s] or [-0.012%; +0.012%] None None None
credit_card/is_card_number/378282246310005 execution_time [100.866µs; 101.027µs] or [-0.079%; +0.079%] None None None
credit_card/is_card_number/378282246310005 throughput [9898757.919op/s; 9914359.557op/s] or [-0.079%; +0.079%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [100.987µs; 101.140µs] or [-0.075%; +0.075%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [9887686.206op/s; 9902400.152op/s] or [-0.074%; +0.074%] None None None
credit_card/is_card_number/x371413321323331 execution_time [20.850µs; 20.855µs] or [-0.014%; +0.014%] None None None
credit_card/is_card_number/x371413321323331 throughput [47949238.297op/s; 47962371.953op/s] or [-0.014%; +0.014%] None None None
credit_card/is_card_number_no_luhn/ execution_time [2.016µs; 2.016µs] or [-0.005%; +0.005%] None None None
credit_card/is_card_number_no_luhn/ throughput [495983398.181op/s; 496033454.632op/s] or [-0.005%; +0.005%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [89.976µs; 90.203µs] or [-0.126%; +0.126%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [11087103.632op/s; 11114842.697op/s] or [-0.125%; +0.125%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [81.414µs; 81.491µs] or [-0.047%; +0.047%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [12271509.126op/s; 12282914.236op/s] or [-0.046%; +0.046%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [2.016µs; 2.017µs] or [-0.016%; +0.016%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [495870590.414op/s; 496027234.487op/s] or [-0.016%; +0.016%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [77.781µs; 77.851µs] or [-0.045%; +0.045%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [12845261.186op/s; 12856710.880op/s] or [-0.045%; +0.045%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [101.000µs; 101.200µs] or [-0.099%; +0.099%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [9882122.829op/s; 9901207.499op/s] or [-0.096%; +0.096%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [20.853µs; 20.863µs] or [-0.025%; +0.025%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [47930947.795op/s; 47955128.714op/s] or [-0.025%; +0.025%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2711241 1727795175 andrew.glaude/NET-tracer
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 306.541ns 316.577ns ± 13.883ns 309.862ns ± 2.495ns 323.416ns 348.880ns 359.714ns 360.111ns 16.22% 1.650 1.749 4.37% 0.982ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [314.653ns; 318.501ns] or [-0.608%; +0.608%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2711241 1727795175 andrew.glaude/NET-tracer
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 37.997µs 38.507µs ± 0.900µs 38.092µs ± 0.049µs 38.179µs 40.414µs 40.454µs 41.799µs 9.73% 1.753 1.303 2.33% 0.064µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [38.382µs; 38.631µs] or [-0.324%; +0.324%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2711241 1727795175 andrew.glaude/NET-tracer
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 1.144µs 1.207µs ± 0.022µs 1.216µs ± 0.011µs 1.221µs 1.230µs 1.231µs 1.231µs 1.24% -1.453 1.398 1.78% 0.002µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [1.204µs; 1.210µs] or [-0.247%; +0.247%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2711241 1727795175 andrew.glaude/NET-tracer
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 9.039ms 9.070ms ± 0.025ms 9.069ms ± 0.009ms 9.078ms 9.088ms 9.100ms 9.369ms 3.31% 8.869 105.489 0.27% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [9.067ms; 9.073ms] or [-0.038%; +0.038%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2711241 1727795175 andrew.glaude/NET-tracer
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 501.077µs 502.596µs ± 0.270µs 502.578µs ± 0.148µs 502.748µs 503.068µs 503.214µs 503.287µs 0.14% -0.614 4.218 0.05% 0.019µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1986937.870op/s 1989671.811op/s ± 1067.365op/s 1989740.786op/s ± 585.063op/s 1990243.825op/s 1991307.027op/s 1991910.824op/s 1995702.145op/s 0.30% 0.624 4.266 0.05% 75.474op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 464.687µs 465.379µs ± 0.287µs 465.388µs ± 0.166µs 465.545µs 465.809µs 466.162µs 466.366µs 0.21% 0.090 0.622 0.06% 0.020µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2144238.403op/s 2148785.984op/s ± 1326.358op/s 2148742.881op/s ± 765.374op/s 2149538.531op/s 2151158.634op/s 2151849.310op/s 2151984.713op/s 0.15% -0.085 0.617 0.06% 93.788op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 179.121µs 180.760µs ± 0.537µs 180.775µs ± 0.349µs 181.111µs 181.592µs 181.813µs 182.027µs 0.69% -0.203 -0.177 0.30% 0.038µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5493697.858op/s 5532233.249op/s ± 16458.477op/s 5531740.592op/s ± 10683.986op/s 5542846.629op/s 5558121.216op/s 5573510.174op/s 5582828.201op/s 0.92% 0.219 -0.159 0.30% 1163.790op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 44.629µs 44.980µs ± 0.133µs 44.984µs ± 0.094µs 45.069µs 45.195µs 45.265µs 45.307µs 0.72% -0.122 -0.216 0.29% 0.009µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 22071576.898op/s 22232387.211op/s ± 65680.439op/s 22230126.289op/s ± 46444.929op/s 22279204.408op/s 22336234.238op/s 22384594.009op/s 22406801.709op/s 0.79% 0.138 -0.213 0.29% 4644.308op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 50.344µs 50.729µs ± 0.275µs 50.654µs ± 0.110µs 50.793µs 51.410µs 51.481µs 51.635µs 1.94% 1.479 1.563 0.54% 0.019µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 19366527.714op/s 19713326.289op/s ± 106032.894op/s 19741963.250op/s ± 43158.694op/s 19780203.543op/s 19822938.976op/s 19856103.151op/s 19863312.369op/s 0.61% -1.456 1.501 0.54% 7497.658op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [502.558µs; 502.633µs] or [-0.007%; +0.007%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1989523.885op/s; 1989819.738op/s] or [-0.007%; +0.007%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [465.339µs; 465.419µs] or [-0.009%; +0.009%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2148602.164op/s; 2148969.804op/s] or [-0.009%; +0.009%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [180.686µs; 180.835µs] or [-0.041%; +0.041%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5529952.263op/s; 5534514.236op/s] or [-0.041%; +0.041%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [44.961µs; 44.998µs] or [-0.041%; +0.041%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [22223284.534op/s; 22241489.888op/s] or [-0.041%; +0.041%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [50.690µs; 50.767µs] or [-0.075%; +0.075%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [19698631.149op/s; 19728021.428op/s] or [-0.075%; +0.075%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 2711241 1727795175 andrew.glaude/NET-tracer
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 76.403µs 76.571µs ± 0.137µs 76.561µs ± 0.031µs 76.589µs 76.647µs 76.932µs 78.264µs 2.23% 9.733 115.385 0.18% 0.010µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [76.552µs; 76.590µs] or [-0.025%; +0.025%] None None None

Baseline

Omitted due to size.

@gleocadie
Copy link
Contributor

👋 FYI, it's being taken into account in #690

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants