Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use append() for writing telemetry lock to file #585

Merged
merged 1 commit into from
Aug 12, 2024
Merged

Conversation

bwoebi
Copy link
Contributor

@bwoebi bwoebi commented Aug 12, 2024

Otherwise we see spurious race conditions where the file is opened twice and one thread is overwriting to the start of the file.

And lock cbindgen version for CI.

Otherwise we see spurious race conditions where the file is opened twice and one thread is overwriting to the start of the file.

And lock cbindgen version for CI.
@bwoebi bwoebi requested review from a team as code owners August 12, 2024 15:36
@pr-commenter
Copy link

pr-commenter bot commented Aug 12, 2024

Benchmarks

Comparison

Benchmark execution time: 2024-08-12 15:44:34

Comparing candidate commit cc052c7 in PR branch bob/flock-mock-client with baseline commit 651d5b4 in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 50 metrics, 2 unstable metrics.

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz cc052c7 1723476890 bob/flock-mock-client
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.428µs 2.894µs ± 1.396µs 2.735µs ± 0.021µs 2.754µs 2.950µs 12.693µs 15.728µs 475.06% 7.938 63.007 48.12% 0.099µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [2.701µs; 3.088µs] or [-6.686%; +6.686%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz cc052c7 1723476890 bob/flock-mock-client
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 506.415µs 507.794µs ± 0.903µs 507.655µs ± 0.252µs 507.914µs 508.808µs 512.505µs 513.309µs 1.11% 3.883 19.043 0.18% 0.064µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1948142.956op/s 1969308.459op/s ± 3479.731op/s 1969841.267op/s ± 978.484op/s 1970766.005op/s 1972476.916op/s 1974188.267op/s 1974665.047op/s 0.24% -3.851 18.808 0.18% 246.054op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 388.966µs 390.575µs ± 0.736µs 390.505µs ± 0.430µs 390.914µs 391.847µs 392.697µs 393.406µs 0.74% 0.805 1.363 0.19% 0.052µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2541902.982op/s 2560337.144op/s ± 4820.729op/s 2560789.803op/s ± 2821.701op/s 2563666.920op/s 2566699.837op/s 2570340.790op/s 2570915.490op/s 0.40% -0.789 1.325 0.19% 340.877op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 180.710µs 180.958µs ± 0.130µs 180.976µs ± 0.086µs 181.055µs 181.147µs 181.253µs 181.281µs 0.17% -0.268 -0.672 0.07% 0.009µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5516301.613op/s 5526132.371op/s ± 3970.249op/s 5525604.980op/s ± 2623.044op/s 5528720.659op/s 5532763.792op/s 5533129.109op/s 5533722.844op/s 0.15% 0.270 -0.673 0.07% 280.739op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 45.469µs 45.625µs ± 0.057µs 45.622µs ± 0.042µs 45.668µs 45.710µs 45.733µs 45.766µs 0.32% -0.089 -0.549 0.12% 0.004µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 21850274.949op/s 21917878.889op/s ± 27170.271op/s 21919237.301op/s ± 20312.875op/s 21937613.485op/s 21964550.283op/s 21976451.253op/s 21992999.214op/s 0.34% 0.094 -0.547 0.12% 1921.228op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 49.882µs 50.173µs ± 0.157µs 50.142µs ± 0.102µs 50.288µs 50.448µs 50.592µs 50.631µs 0.97% 0.646 -0.129 0.31% 0.011µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 19750805.962op/s 19931380.247op/s ± 62420.190op/s 19943180.942op/s ± 40655.957op/s 19979907.111op/s 20017674.899op/s 20037624.218op/s 20047225.536op/s 0.52% -0.632 -0.153 0.31% 4413.774op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [507.669µs; 507.919µs] or [-0.025%; +0.025%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1968826.202op/s; 1969790.716op/s] or [-0.024%; +0.024%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [390.473µs; 390.677µs] or [-0.026%; +0.026%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2559669.037op/s; 2561005.250op/s] or [-0.026%; +0.026%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [180.940µs; 180.976µs] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5525582.133op/s; 5526682.609op/s] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [45.617µs; 45.633µs] or [-0.017%; +0.017%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [21914113.351op/s; 21921644.427op/s] or [-0.017%; +0.017%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [50.151µs; 50.194µs] or [-0.043%; +0.043%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [19922729.409op/s; 19940031.085op/s] or [-0.043%; +0.043%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz cc052c7 1723476890 bob/flock-mock-client
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.657µs 2.709µs ± 0.019µs 2.712µs ± 0.010µs 2.722µs 2.733µs 2.743µs 2.744µs 1.20% -0.942 0.624 0.70% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.706µs; 2.711µs] or [-0.097%; +0.097%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz cc052c7 1723476890 bob/flock-mock-client
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 73.222µs 73.347µs ± 0.142µs 73.333µs ± 0.028µs 73.356µs 73.455µs 73.696µs 75.099µs 2.41% 9.759 114.597 0.19% 0.010µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [73.327µs; 73.367µs] or [-0.027%; +0.027%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz cc052c7 1723476890 bob/flock-mock-client
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 2.415µs 2.416µs ± 0.001µs 2.416µs ± 0.001µs 2.417µs 2.417µs 2.417µs 2.419µs 0.11% 0.409 -0.185 0.03% 0.000µs 1 200
credit_card/is_card_number/ throughput 413461044.636op/s 413902213.435op/s ± 117138.511op/s 413931340.420op/s ± 93806.055op/s 413998936.839op/s 414061481.896op/s 414108521.202op/s 414134372.092op/s 0.05% -0.407 -0.189 0.03% 8282.944op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 105.259µs 107.490µs ± 2.008µs 106.808µs ± 1.188µs 108.397µs 111.557µs 112.963µs 113.390µs 6.16% 1.084 0.334 1.86% 0.142µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 8819137.414op/s 9306323.271op/s ± 170532.384op/s 9362631.809op/s ± 105155.628op/s 9441223.494op/s 9490568.045op/s 9496401.266op/s 9500408.262op/s 1.47% -1.021 0.168 1.83% 12058.461op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 100.891µs 104.141µs ± 2.248µs 103.498µs ± 1.425µs 105.870µs 108.432µs 109.457µs 110.068µs 6.35% 0.711 -0.498 2.15% 0.159µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 9085312.504op/s 9606792.379op/s ± 204399.854op/s 9662065.916op/s ± 133443.769op/s 9763574.287op/s 9860119.334op/s 9898403.846op/s 9911688.917op/s 2.58% -0.648 -0.605 2.12% 14453.252op/s 1 200
credit_card/is_card_number/37828224631 execution_time 2.415µs 2.417µs ± 0.005µs 2.416µs ± 0.001µs 2.417µs 2.417µs 2.418µs 2.487µs 2.95% 13.615 187.183 0.21% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 402020807.758op/s 413798995.488op/s ± 846008.009op/s 413874836.419op/s ± 101347.663op/s 413960790.143op/s 414018885.523op/s 414049599.434op/s 414062312.426op/s 0.05% -13.591 186.733 0.20% 59821.800op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 97.811µs 102.011µs ± 2.957µs 101.615µs ± 2.830µs 104.936µs 106.112µs 106.855µs 107.431µs 5.72% 0.122 -1.556 2.89% 0.209µs 1 200
credit_card/is_card_number/378282246310005 throughput 9308295.791op/s 9811041.550op/s ± 283525.278op/s 9841108.107op/s ± 281488.856op/s 10088008.998op/s 10190254.124op/s 10214653.460op/s 10223747.763op/s 3.89% -0.085 -1.567 2.88% 20048.265op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 102.558µs 108.182µs ± 1.286µs 108.169µs ± 0.750µs 108.916µs 110.230µs 110.818µs 113.795µs 5.20% -0.035 3.253 1.19% 0.091µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 8787727.289op/s 9244972.727op/s ± 110083.769op/s 9244763.144op/s ± 63643.164op/s 9308209.981op/s 9401335.946op/s 9547522.540op/s 9750577.059op/s 5.47% 0.222 3.342 1.19% 7784.098op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 22.219µs 23.726µs ± 0.514µs 23.685µs ± 0.368µs 24.104µs 24.528µs 24.770µs 25.003µs 5.57% 0.113 -0.375 2.16% 0.036µs 1 200
credit_card/is_card_number/x371413321323331 throughput 39995295.565op/s 42166926.007op/s ± 911690.192op/s 42221412.731op/s ± 656537.958op/s 42858216.627op/s 43501591.380op/s 44160400.758op/s 45006655.854op/s 6.60% -0.006 -0.313 2.16% 64466.232op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 2.415µs 2.416µs ± 0.001µs 2.416µs ± 0.001µs 2.417µs 2.417µs 2.418µs 2.420µs 0.15% 0.903 1.857 0.03% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 413280162.412op/s 413888433.547op/s ± 123888.916op/s 413901138.252op/s ± 96977.338op/s 413991171.206op/s 414042258.711op/s 414068723.481op/s 414073828.193op/s 0.04% -0.900 1.842 0.03% 8760.269op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 89.184µs 90.272µs ± 3.550µs 89.845µs ± 0.165µs 90.092µs 90.760µs 92.614µs 134.092µs 49.25% 10.847 123.185 3.92% 0.251µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 7457557.509op/s 11089645.867op/s ± 309133.716op/s 11130339.108op/s ± 20498.879op/s 11145341.032op/s 11190090.978op/s 11209536.144op/s 11212816.249op/s 0.74% -10.145 107.743 2.78% 21859.055op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 82.754µs 84.881µs ± 1.321µs 84.581µs ± 0.865µs 85.743µs 87.460µs 88.524µs 88.871µs 5.07% 0.891 0.282 1.55% 0.093µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 11252288.124op/s 11784016.539op/s ± 180963.384op/s 11823011.151op/s ± 121881.593op/s 11927223.508op/s 12007762.816op/s 12035610.287op/s 12084078.561op/s 2.21% -0.824 0.121 1.53% 12796.044op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 2.415µs 2.416µs ± 0.001µs 2.416µs ± 0.001µs 2.417µs 2.417µs 2.419µs 2.420µs 0.16% 0.965 2.082 0.03% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 413227225.742op/s 413871121.048op/s ± 133772.922op/s 413878636.951op/s ± 99622.088op/s 413978642.134op/s 414038724.378op/s 414085739.453op/s 414105071.206op/s 0.05% -0.962 2.067 0.03% 9459.174op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 81.920µs 84.347µs ± 0.800µs 84.449µs ± 0.630µs 85.019µs 85.400µs 85.716µs 85.882µs 1.70% -0.470 -0.548 0.95% 0.057µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 11643821.945op/s 11856813.464op/s ± 112989.140op/s 11841431.689op/s ± 88175.358op/s 11940091.362op/s 12057751.400op/s 12091998.991op/s 12207067.564op/s 3.09% 0.506 -0.492 0.95% 7989.539op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 104.934µs 108.394µs ± 1.070µs 108.371µs ± 0.650µs 109.101µs 110.182µs 111.101µs 111.315µs 2.72% 0.072 0.447 0.98% 0.076µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 8983532.605op/s 9226455.956op/s ± 91022.888op/s 9227523.368op/s ± 55705.088op/s 9279692.671op/s 9359505.247op/s 9441585.372op/s 9529783.083op/s 3.28% 0.000 0.483 0.98% 6436.290op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 22.580µs 23.780µs ± 0.435µs 23.831µs ± 0.275µs 24.061µs 24.499µs 24.650µs 24.821µs 4.15% -0.250 -0.158 1.83% 0.031µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 40288430.713op/s 42066757.469op/s ± 774590.446op/s 41961353.598op/s ± 490333.174op/s 42575359.814op/s 43451445.956op/s 44043013.652op/s 44286215.605op/s 5.54% 0.348 -0.085 1.84% 54771.816op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [2.416µs; 2.416µs] or [-0.004%; +0.004%] None None None
credit_card/is_card_number/ throughput [413885979.164op/s; 413918447.706op/s] or [-0.004%; +0.004%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [107.212µs; 107.769µs] or [-0.259%; +0.259%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [9282689.122op/s; 9329957.419op/s] or [-0.254%; +0.254%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [103.829µs; 104.452µs] or [-0.299%; +0.299%] None None None
credit_card/is_card_number/ 378282246310005 throughput [9578464.525op/s; 9635120.233op/s] or [-0.295%; +0.295%] None None None
credit_card/is_card_number/37828224631 execution_time [2.416µs; 2.417µs] or [-0.029%; +0.029%] None None None
credit_card/is_card_number/37828224631 throughput [413681746.914op/s; 413916244.061op/s] or [-0.028%; +0.028%] None None None
credit_card/is_card_number/378282246310005 execution_time [101.601µs; 102.421µs] or [-0.402%; +0.402%] None None None
credit_card/is_card_number/378282246310005 throughput [9771747.673op/s; 9850335.426op/s] or [-0.401%; +0.401%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [108.004µs; 108.360µs] or [-0.165%; +0.165%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [9229716.175op/s; 9260229.279op/s] or [-0.165%; +0.165%] None None None
credit_card/is_card_number/x371413321323331 execution_time [23.655µs; 23.798µs] or [-0.300%; +0.300%] None None None
credit_card/is_card_number/x371413321323331 throughput [42040574.515op/s; 42293277.500op/s] or [-0.300%; +0.300%] None None None
credit_card/is_card_number_no_luhn/ execution_time [2.416µs; 2.416µs] or [-0.004%; +0.004%] None None None
credit_card/is_card_number_no_luhn/ throughput [413871263.735op/s; 413905603.359op/s] or [-0.004%; +0.004%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [89.780µs; 90.764µs] or [-0.545%; +0.545%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [11046802.907op/s; 11132488.827op/s] or [-0.386%; +0.386%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [84.698µs; 85.064µs] or [-0.216%; +0.216%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [11758936.754op/s; 11809096.323op/s] or [-0.213%; +0.213%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [2.416µs; 2.416µs] or [-0.004%; +0.004%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [413852581.407op/s; 413889660.688op/s] or [-0.004%; +0.004%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [84.236µs; 84.458µs] or [-0.131%; +0.131%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [11841154.256op/s; 11872472.672op/s] or [-0.132%; +0.132%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [108.246µs; 108.543µs] or [-0.137%; +0.137%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [9213841.059op/s; 9239070.853op/s] or [-0.137%; +0.137%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [23.719µs; 23.840µs] or [-0.254%; +0.254%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [41959406.683op/s; 42174108.255op/s] or [-0.255%; +0.255%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz cc052c7 1723476890 bob/flock-mock-client
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 133.809µs 134.201µs ± 0.354µs 134.146µs ± 0.132µs 134.308µs 134.543µs 134.819µs 138.247µs 3.06% 7.650 83.262 0.26% 0.025µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [134.152µs; 134.251µs] or [-0.037%; +0.037%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz cc052c7 1723476890 bob/flock-mock-client
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 1.147µs 1.348µs ± 0.062µs 1.351µs ± 0.049µs 1.397µs 1.434µs 1.442µs 1.444µs 6.88% -0.680 0.648 4.58% 0.004µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [1.340µs; 1.357µs] or [-0.636%; +0.636%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz cc052c7 1723476890 bob/flock-mock-client
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 16.852µs 22.775µs ± 15.557µs 17.009µs ± 0.076µs 17.196µs 50.493µs 53.806µs 148.809µs 774.86% 4.626 29.267 68.13% 1.100µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [20.619µs; 24.931µs] or [-9.467%; +9.467%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz cc052c7 1723476890 bob/flock-mock-client
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 37.517µs 38.083µs ± 0.902µs 37.677µs ± 0.079µs 37.810µs 40.022µs 40.051µs 41.099µs 9.08% 1.708 1.091 2.36% 0.064µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [37.958µs; 38.208µs] or [-0.328%; +0.328%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz cc052c7 1723476890 bob/flock-mock-client
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 299.121ns 309.375ns ± 13.656ns 303.333ns ± 3.678ns 312.147ns 341.646ns 354.712ns 357.468ns 17.85% 1.913 3.136 4.40% 0.966ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [307.482ns; 311.267ns] or [-0.612%; +0.612%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz cc052c7 1723476890 bob/flock-mock-client
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 281.151µs 282.544µs ± 2.045µs 281.545µs ± 0.170µs 282.550µs 287.687µs 289.345µs 289.490µs 2.82% 2.026 3.254 0.72% 0.145µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 3454356.515op/s 3539449.278op/s ± 25248.886op/s 3551830.734op/s ± 2151.374op/s 3553217.457op/s 3555141.187op/s 3556611.718op/s 3556813.223op/s 0.14% -2.001 3.133 0.71% 1785.366op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 27.332µs 27.549µs ± 0.107µs 27.541µs ± 0.081µs 27.628µs 27.739µs 27.775µs 27.796µs 0.93% 0.229 -0.719 0.39% 0.008µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 35976399.482op/s 36299698.660op/s ± 140319.481op/s 36309332.728op/s ± 107439.656op/s 36410219.411op/s 36518063.241op/s 36567916.772op/s 36586576.908op/s 0.76% -0.215 -0.725 0.39% 9922.086op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 16.597µs 16.628µs ± 0.029µs 16.613µs ± 0.008µs 16.646µs 16.687µs 16.703µs 16.770µs 0.95% 1.519 2.400 0.18% 0.002µs 1 200
normalization/normalize_name/normalize_name/good throughput 59629441.247op/s 60138292.558op/s ± 106066.515op/s 60194304.129op/s ± 28303.336op/s 60212418.605op/s 60229716.137op/s 60239400.036op/s 60250704.727op/s 0.09% -1.508 2.336 0.18% 7500.035op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [282.261µs; 282.828µs] or [-0.100%; +0.100%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [3535950.025op/s; 3542948.530op/s] or [-0.099%; +0.099%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [27.534µs; 27.564µs] or [-0.054%; +0.054%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [36280251.730op/s; 36319145.591op/s] or [-0.054%; +0.054%] None None None
normalization/normalize_name/normalize_name/good execution_time [16.624µs; 16.632µs] or [-0.025%; +0.025%] None None None
normalization/normalize_name/normalize_name/good throughput [60123592.759op/s; 60152992.357op/s] or [-0.024%; +0.024%] None None None

Baseline

Omitted due to size.

@@ -60,7 +60,7 @@ ENV PATH="/root/.cargo/bin:$PATH"
ARG CARGO_BUILD_INCREMENTAL
ARG CARGO_NET_RETRY
ENV CARGO_NET_RETRY="${CARGO_NET_RETRY}"
RUN cargo install cbindgen && cargo install bindgen-cli --locked && rm -rf /root/.cargo/registry /root/.cargo/git
RUN cargo install cbindgen --version "^0.26" && cargo install bindgen-cli --locked && rm -rf /root/.cargo/registry /root/.cargo/git
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should this specify a version for bindgen-cli?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I have no idea.

@codecov-commenter
Copy link

codecov-commenter commented Aug 12, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 71.27%. Comparing base (651d5b4) to head (cc052c7).
Report is 15 commits behind head on main.

Additional details and impacted files
@@           Coverage Diff           @@
##             main     #585   +/-   ##
=======================================
  Coverage   71.26%   71.27%           
=======================================
  Files         220      220           
  Lines       29924    29929    +5     
=======================================
+ Hits        21326    21331    +5     
  Misses       8598     8598           
Components Coverage Δ
crashtracker 21.17% <ø> (ø)
datadog-alloc 98.73% <ø> (ø)
data-pipeline 50.00% <ø> (ø)
data-pipeline-ffi 0.00% <ø> (ø)
ddcommon 83.07% <ø> (ø)
ddcommon-ffi 70.20% <ø> (ø)
ddtelemetry 59.02% <100.00%> (+0.07%) ⬆️
ipc 84.18% <ø> (ø)
profiling 84.26% <ø> (ø)
profiling-ffi 77.42% <ø> (ø)
serverless 0.00% <ø> (ø)
sidecar 34.55% <ø> (ø)
sidecar-ffi 0.00% <ø> (ø)
spawn-worker 54.87% <ø> (ø)
trace-mini-agent 70.88% <ø> (ø)
trace-normalization 98.25% <ø> (ø)
trace-obfuscation 95.73% <ø> (ø)
trace-protobuf 77.16% <ø> (ø)
trace-utils 92.96% <ø> (ø)

@bwoebi bwoebi merged commit b9d4da7 into main Aug 12, 2024
34 checks passed
@bwoebi bwoebi deleted the bob/flock-mock-client branch August 12, 2024 16:30
hoolioh pushed a commit that referenced this pull request Aug 21, 2024
Otherwise we see spurious race conditions where the file is opened twice and one thread is overwriting to the start of the file.

And lock cbindgen version for CI.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants