Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Serverless Mini Agent] Bump datadog-serverless-trace-mini-agent version to 0.7.0 #623

Merged
merged 2 commits into from
Sep 13, 2024
Merged

[Serverless Mini Agent] Bump datadog-serverless-trace-mini-agent version to 0.7.0 #623

merged 2 commits into from
Sep 13, 2024

Conversation

duncanpharvey
Copy link
Contributor

What does this PR do?

Bumps Serverless Mini Agent Version to 0.7.0.

Motivation

Upcoming release of version 0.7.0.

Additional Notes

How to test the change?

See https://datadoghq.atlassian.net/wiki/spaces/SLS/pages/2977497119/Serverless+Mini+Agent#Testing

@pr-commenter
Copy link

pr-commenter bot commented Sep 12, 2024 •
edited
Loading

Benchmarks

Comparison

Benchmark execution time: 2024-09-13 13:06:57

Comparing candidate commit 91a4c85 in PR branch duncan-harvey/serverless-mini-agent-bump-version with baseline commit dea9035 in branch main.

Found 0 performance improvements and 1 performance regressions! Performance is the same for 50 metrics, 2 unstable metrics.

scenario:tags/replace_trace_tags

  • 🟥 execution_time [+86.880ns; +92.849ns] or [+3.253%; +3.476%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 91a4c85 1726232124 duncan-harvey/serverless-mini-agent-bump-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 8.932ms 8.973ms ± 0.025ms 8.969ms ± 0.012ms 8.982ms 9.005ms 9.062ms 9.150ms 2.02% 3.797 23.633 0.28% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [8.970ms; 8.977ms] or [-0.039%; +0.039%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 91a4c85 1726232124 duncan-harvey/serverless-mini-agent-bump-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 75.627µs 75.765µs ± 0.149µs 75.758µs ± 0.045µs 75.793µs 75.868µs 76.089µs 77.438µs 2.22% 8.057 82.706 0.20% 0.011µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [75.744µs; 75.785µs] or [-0.027%; +0.027%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 91a4c85 1726232124 duncan-harvey/serverless-mini-agent-bump-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 20.589µs 27.935µs ± 12.494µs 21.689µs ± 0.227µs 37.008µs 49.348µs 51.977µs 113.378µs 422.75% 3.517 19.166 44.61% 0.883µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [26.203µs; 29.667µs] or [-6.199%; +6.199%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 91a4c85 1726232124 duncan-harvey/serverless-mini-agent-bump-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 506.614µs 507.476µs ± 0.354µs 507.425µs ± 0.193µs 507.638µs 508.067µs 508.373µs 509.585µs 0.43% 1.299 5.502 0.07% 0.025µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1962381.606op/s 1970537.253op/s ± 1373.797op/s 1970734.706op/s ± 748.655op/s 1971340.821op/s 1972416.429op/s 1973227.862op/s 1973888.704op/s 0.16% -1.287 5.427 0.07% 97.142op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 467.317µs 468.377µs ± 0.404µs 468.347µs ± 0.293µs 468.657µs 469.063µs 469.307µs 469.643µs 0.28% 0.255 -0.309 0.09% 0.029µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2129279.066op/s 2135033.233op/s ± 1840.862op/s 2135167.810op/s ± 1334.449op/s 2136459.191op/s 2137723.428op/s 2138337.075op/s 2139876.520op/s 0.22% -0.251 -0.312 0.09% 130.169op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 179.713µs 180.216µs ± 0.269µs 180.157µs ± 0.180µs 180.376µs 180.753µs 180.868µs 181.213µs 0.59% 0.832 0.421 0.15% 0.019µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5518356.746op/s 5548910.808op/s ± 8279.142op/s 5550726.499op/s ± 5531.613op/s 5555306.584op/s 5559254.041op/s 5563739.855op/s 5564416.399op/s 0.25% -0.824 0.401 0.15% 585.424op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 43.390µs 43.637µs ± 0.107µs 43.625µs ± 0.086µs 43.728µs 43.800µs 43.851µs 43.903µs 0.64% 0.124 -0.778 0.25% 0.008µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 22777265.422op/s 22916311.976op/s ± 56283.769op/s 22922500.152op/s ± 45430.275op/s 22960879.238op/s 22999945.690op/s 23029913.268op/s 23046643.828op/s 0.54% -0.115 -0.779 0.24% 3979.863op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 49.966µs 50.262µs ± 0.153µs 50.320µs ± 0.095µs 50.381µs 50.451µs 50.477µs 50.534µs 0.42% -0.475 -1.183 0.30% 0.011µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 19788798.298op/s 19896069.441op/s ± 60596.070op/s 19872809.415op/s ± 37545.864op/s 19957140.933op/s 19996615.457op/s 20007420.240op/s 20013516.105op/s 0.71% 0.481 -1.180 0.30% 4284.789op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [507.427µs; 507.525µs] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1970346.858op/s; 1970727.648op/s] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [468.321µs; 468.433µs] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2134778.107op/s; 2135288.359op/s] or [-0.012%; +0.012%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [180.179µs; 180.253µs] or [-0.021%; +0.021%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5547763.398op/s; 5550058.217op/s] or [-0.021%; +0.021%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [43.622µs; 43.652µs] or [-0.034%; +0.034%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [22908511.587op/s; 22924112.365op/s] or [-0.034%; +0.034%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [50.240µs; 50.283µs] or [-0.042%; +0.042%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [19887671.409op/s; 19904467.474op/s] or [-0.042%; +0.042%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 91a4c85 1726232124 duncan-harvey/serverless-mini-agent-bump-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 1.195µs 1.373µs ± 0.053µs 1.389µs ± 0.031µs 1.413µs 1.448µs 1.470µs 1.471µs 5.88% -0.783 0.904 3.88% 0.004µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [1.366µs; 1.381µs] or [-0.540%; +0.540%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 91a4c85 1726232124 duncan-harvey/serverless-mini-agent-bump-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 292.277ns 305.720ns ± 14.978ns 297.702ns ± 4.303ns 312.997ns 334.864ns 350.457ns 353.121ns 18.62% 1.348 1.173 4.89% 1.059ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [303.644ns; 307.796ns] or [-0.679%; +0.679%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 91a4c85 1726232124 duncan-harvey/serverless-mini-agent-bump-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.342µs 3.188µs ± 1.532µs 3.038µs ± 0.029µs 3.065µs 3.111µs 13.777µs 17.558µs 477.98% 7.953 63.861 47.95% 0.108µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [2.976µs; 3.401µs] or [-6.662%; +6.662%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 91a4c85 1726232124 duncan-harvey/serverless-mini-agent-bump-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.733µs 2.761µs ± 0.011µs 2.762µs ± 0.006µs 2.768µs 2.777µs 2.787µs 2.790µs 1.03% -0.037 0.128 0.40% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.759µs; 2.762µs] or [-0.055%; +0.055%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 91a4c85 1726232124 duncan-harvey/serverless-mini-agent-bump-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 1.208µs 1.208µs ± 0.001µs 1.208µs ± 0.000µs 1.209µs 1.209µs 1.210µs 1.222µs 1.09% 10.511 131.417 0.08% 0.000µs 1 200
credit_card/is_card_number/ throughput 818644153.145op/s 827511147.253op/s ± 695617.667op/s 827570922.829op/s ± 229689.612op/s 827820842.664op/s 827899482.198op/s 827938161.435op/s 827968381.714op/s 0.05% -10.453 130.414 0.08% 49187.597op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 108.657µs 110.871µs ± 0.771µs 111.014µs ± 0.430µs 111.322µs 111.718µs 113.272µs 113.894µs 2.59% -0.022 2.037 0.69% 0.055µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 8780122.574op/s 9019919.443op/s ± 62745.325op/s 9007844.797op/s ± 34898.835op/s 9057270.741op/s 9111657.077op/s 9194973.781op/s 9203230.799op/s 2.17% 0.104 1.905 0.69% 4436.764op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 101.829µs 103.398µs ± 0.651µs 103.500µs ± 0.443µs 103.832µs 104.277µs 105.077µs 105.800µs 2.22% 0.090 0.405 0.63% 0.046µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 9451793.078op/s 9671765.376op/s ± 60832.246op/s 9661808.847op/s ± 41382.278op/s 9720520.263op/s 9779808.033op/s 9801695.696op/s 9820431.884op/s 1.64% -0.046 0.336 0.63% 4301.489op/s 1 200
credit_card/is_card_number/37828224631 execution_time 1.208µs 1.209µs ± 0.001µs 1.210µs ± 0.001µs 1.210µs 1.211µs 1.211µs 1.221µs 0.97% 4.286 41.873 0.10% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 818752874.987op/s 826811109.550op/s ± 837171.311op/s 826670738.236op/s ± 385457.875op/s 827450802.918op/s 827884179.916op/s 827973390.760op/s 828009852.847op/s 0.16% -4.209 40.939 0.10% 59196.951op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 97.977µs 99.776µs ± 0.661µs 99.829µs ± 0.326µs 100.128µs 100.683µs 101.528µs 102.889µs 3.07% 0.290 3.116 0.66% 0.047µs 1 200
credit_card/is_card_number/378282246310005 throughput 9719231.804op/s 10022922.112op/s ± 66304.946op/s 10017141.862op/s ± 32689.611op/s 10052020.218op/s 10147818.932op/s 10191895.967op/s 10206480.155op/s 1.89% -0.192 2.862 0.66% 4688.468op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 93.879µs 95.377µs ± 0.744µs 95.231µs ± 0.398µs 95.730µs 96.571µs 98.339µs 98.752µs 3.70% 1.704 4.599 0.78% 0.053µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 10126340.076op/s 10485347.151op/s ± 80780.832op/s 10500794.417op/s ± 43914.131op/s 10536354.397op/s 10583128.105op/s 10604984.737op/s 10652006.260op/s 1.44% -1.620 4.225 0.77% 5712.067op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 20.314µs 21.256µs ± 0.362µs 21.278µs ± 0.261µs 21.507µs 21.794µs 22.160µs 22.339µs 4.98% -0.031 -0.059 1.70% 0.026µs 1 200
credit_card/is_card_number/x371413321323331 throughput 44765139.599op/s 47058844.686op/s ± 802633.815op/s 46995808.103op/s ± 574992.950op/s 47606404.486op/s 48463696.488op/s 48839592.428op/s 49226213.571op/s 4.75% 0.129 -0.080 1.70% 56754.781op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 1.208µs 1.208µs ± 0.000µs 1.208µs ± 0.000µs 1.209µs 1.209µs 1.209µs 1.209µs 0.08% 0.121 -0.762 0.03% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 826877144.001op/s 827574814.614op/s ± 237914.674op/s 827537769.160op/s ± 193302.056op/s 827802397.687op/s 827927006.330op/s 827957889.771op/s 828050790.851op/s 0.06% -0.120 -0.764 0.03% 16823.108op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 93.418µs 95.909µs ± 0.503µs 95.986µs ± 0.267µs 96.213µs 96.598µs 96.751µs 96.904µs 0.96% -1.543 5.349 0.52% 0.036µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 10319471.171op/s 10426829.071op/s ± 55161.807op/s 10418228.884op/s ± 29074.920op/s 10454370.337op/s 10510294.318op/s 10671686.715op/s 10704528.209op/s 2.75% 1.623 5.750 0.53% 3900.529op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 85.522µs 87.079µs ± 0.616µs 86.999µs ± 0.317µs 87.398µs 88.181µs 89.048µs 89.133µs 2.45% 0.767 1.654 0.71% 0.044µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 11219182.791op/s 11484367.756op/s ± 80796.826op/s 11494443.654op/s ± 41993.494op/s 11529536.089op/s 11596971.278op/s 11679570.040op/s 11692849.409op/s 1.73% -0.702 1.553 0.70% 5713.198op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 1.208µs 1.209µs ± 0.002µs 1.208µs ± 0.000µs 1.209µs 1.211µs 1.212µs 1.232µs 1.92% 10.510 129.365 0.15% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 811907824.131op/s 827327948.065op/s ± 1216469.436op/s 827474974.493op/s ± 272385.541op/s 827773727.916op/s 827873812.605op/s 827937743.557op/s 827985197.922op/s 0.06% -10.417 127.684 0.15% 86017.379op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 80.741µs 82.911µs ± 0.725µs 82.913µs ± 0.389µs 83.287µs 83.938µs 85.295µs 85.689µs 3.35% 0.575 2.102 0.87% 0.051µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 11670095.842op/s 12062004.541op/s ± 105000.025op/s 12060828.845op/s ± 56579.633op/s 12118742.439op/s 12217542.305op/s 12304081.138op/s 12385354.860op/s 2.69% -0.477 1.925 0.87% 7424.623op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 93.370µs 94.264µs ± 0.684µs 94.138µs ± 0.247µs 94.408µs 95.014µs 97.325µs 99.263µs 5.44% 3.747 19.690 0.72% 0.048µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 10074271.366op/s 10609032.157op/s ± 74994.505op/s 10622655.556op/s ± 27837.764op/s 10648272.673op/s 10682577.373op/s 10701276.501op/s 10710105.495op/s 0.82% -3.586 18.235 0.71% 5302.912op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 20.374µs 21.273µs ± 0.365µs 21.247µs ± 0.244µs 21.530µs 21.848µs 22.084µs 22.338µs 5.13% 0.045 -0.144 1.71% 0.026µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 44767519.888op/s 47021159.544op/s ± 807589.913op/s 47065935.277op/s ± 542850.351op/s 47521665.533op/s 48332605.646op/s 48907501.828op/s 49081799.623op/s 4.28% 0.050 -0.146 1.71% 57105.230op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [1.208µs; 1.209µs] or [-0.012%; +0.012%] None None None
credit_card/is_card_number/ throughput [827414741.334op/s; 827607553.171op/s] or [-0.012%; +0.012%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [110.764µs; 110.978µs] or [-0.096%; +0.096%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [9011223.545op/s; 9028615.342op/s] or [-0.096%; +0.096%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [103.308µs; 103.488µs] or [-0.087%; +0.087%] None None None
credit_card/is_card_number/ 378282246310005 throughput [9663334.612op/s; 9680196.140op/s] or [-0.087%; +0.087%] None None None
credit_card/is_card_number/37828224631 execution_time [1.209µs; 1.210µs] or [-0.014%; +0.014%] None None None
credit_card/is_card_number/37828224631 throughput [826695085.658op/s; 826927133.443op/s] or [-0.014%; +0.014%] None None None
credit_card/is_card_number/378282246310005 execution_time [99.684µs; 99.867µs] or [-0.092%; +0.092%] None None None
credit_card/is_card_number/378282246310005 throughput [10013732.884op/s; 10032111.340op/s] or [-0.092%; +0.092%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [95.274µs; 95.480µs] or [-0.108%; +0.108%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [10474151.704op/s; 10496542.597op/s] or [-0.107%; +0.107%] None None None
credit_card/is_card_number/x371413321323331 execution_time [21.206µs; 21.306µs] or [-0.236%; +0.236%] None None None
credit_card/is_card_number/x371413321323331 throughput [46947607.359op/s; 47170082.013op/s] or [-0.236%; +0.236%] None None None
credit_card/is_card_number_no_luhn/ execution_time [1.208µs; 1.208µs] or [-0.004%; +0.004%] None None None
credit_card/is_card_number_no_luhn/ throughput [827541841.928op/s; 827607787.299op/s] or [-0.004%; +0.004%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [95.839µs; 95.979µs] or [-0.073%; +0.073%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [10419184.175op/s; 10434473.967op/s] or [-0.073%; +0.073%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [86.994µs; 87.165µs] or [-0.098%; +0.098%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [11473170.093op/s; 11495565.419op/s] or [-0.098%; +0.098%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [1.208µs; 1.209µs] or [-0.021%; +0.021%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [827159357.100op/s; 827496539.029op/s] or [-0.020%; +0.020%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [82.811µs; 83.012µs] or [-0.121%; +0.121%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [12047452.547op/s; 12076556.535op/s] or [-0.121%; +0.121%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [94.169µs; 94.359µs] or [-0.101%; +0.101%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [10598638.640op/s; 10619425.675op/s] or [-0.098%; +0.098%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [21.223µs; 21.324µs] or [-0.238%; +0.238%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [46909235.350op/s; 47133083.739op/s] or [-0.238%; +0.238%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 91a4c85 1726232124 duncan-harvey/serverless-mini-agent-bump-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 139.935µs 141.225µs ± 0.386µs 141.236µs ± 0.205µs 141.456µs 141.787µs 142.035µs 142.768µs 1.08% -0.257 1.988 0.27% 0.027µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [141.172µs; 141.279µs] or [-0.038%; +0.038%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 91a4c85 1726232124 duncan-harvey/serverless-mini-agent-bump-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 269.085µs 272.783µs ± 1.427µs 272.657µs ± 0.876µs 273.675µs 275.198µs 276.391µs 276.689µs 1.48% 0.235 -0.066 0.52% 0.101µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 3614161.581op/s 3666016.278op/s ± 19155.048op/s 3667614.935op/s ± 11811.602op/s 3678023.770op/s 3697057.712op/s 3706971.930op/s 3716294.967op/s 1.33% -0.206 -0.074 0.52% 1354.466op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 25.758µs 25.793µs ± 0.036µs 25.769µs ± 0.010µs 25.813µs 25.864µs 25.880µs 25.901µs 0.51% 0.860 -0.356 0.14% 0.003µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 38609222.942op/s 38769844.970op/s ± 54617.594op/s 38806267.952op/s ± 14837.619op/s 38815810.193op/s 38820055.620op/s 38821263.103op/s 38823259.674op/s 0.04% -0.856 -0.367 0.14% 3862.047op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 15.310µs 15.361µs ± 0.036µs 15.359µs ± 0.023µs 15.379µs 15.421µs 15.456µs 15.494µs 0.88% 0.745 0.516 0.23% 0.003µs 1 200
normalization/normalize_name/normalize_name/good throughput 64541497.742op/s 65100542.330op/s ± 152011.484op/s 65107230.025op/s ± 98320.978op/s 65214073.631op/s 65310871.516op/s 65316250.444op/s 65317467.592op/s 0.32% -0.731 0.479 0.23% 10748.835op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [272.585µs; 272.981µs] or [-0.072%; +0.072%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [3663361.572op/s; 3668670.983op/s] or [-0.072%; +0.072%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [25.788µs; 25.798µs] or [-0.020%; +0.020%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [38762275.496op/s; 38777414.443op/s] or [-0.020%; +0.020%] None None None
normalization/normalize_name/normalize_name/good execution_time [15.356µs; 15.366µs] or [-0.032%; +0.032%] None None None
normalization/normalize_name/normalize_name/good throughput [65079475.000op/s; 65121609.660op/s] or [-0.032%; +0.032%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 91a4c85 1726232124 duncan-harvey/serverless-mini-agent-bump-version
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 37.723µs 38.365µs ± 1.145µs 37.834µs ± 0.052µs 37.936µs 40.829µs 40.890µs 41.499µs 9.69% 1.701 0.939 2.98% 0.081µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [38.206µs; 38.524µs] or [-0.413%; +0.413%] None None None

Baseline

Omitted due to size.

@codecov-commenter
Copy link

codecov-commenter commented Sep 12, 2024 •
edited
Loading

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 73.01%. Comparing base (dea9035) to head (91a4c85).

Additional details and impacted files 
@@            Coverage Diff             @@
##             main     #623      +/-   ##
==========================================
- Coverage   73.03%   73.01%   -0.02%     
==========================================
  Files         252      252              
  Lines       36050    36050              
==========================================
- Hits        26330    26323       -7     
- Misses       9720     9727       +7
Components Coverage Δ
crashtracker 20.53% <ø> (ø)
datadog-alloc 98.73% <ø> (ø)
data-pipeline 90.12% <ø> (ø)
data-pipeline-ffi 0.00% <ø> (ø)
ddcommon 83.08% <ø> (ø)
ddcommon-ffi 69.52% <ø> (ø)
ddtelemetry 59.10% <ø> (ø)
ipc 83.63% <ø> (ø)
profiling 84.26% <ø> (ø)
profiling-ffi 77.42% <ø> (ø)
serverless 0.00% <ø> (ø)
sidecar 40.12% <ø> (ø)
sidecar-ffi 0.00% <ø> (ø)
spawn-worker 50.36% <ø> (ø)
tinybytes 91.66% <ø> (ø)
trace-mini-agent 72.49% <ø> (ø)
trace-normalization 98.25% <ø> (ø)
trace-obfuscation 95.73% <ø> (ø)
trace-protobuf 77.67% <ø> (ø)
trace-utils 92.88% <ø> (ø)

@duncanpharvey duncanpharvey marked this pull request as ready for review September 13, 2024 12:55
@duncanpharvey duncanpharvey requested review from a team as code owners September 13, 2024 12:55
@duncanpharvey duncanpharvey merged commit ebba7e9 into main Sep 13, 2024
30 checks passed
@duncanpharvey duncanpharvey deleted the duncan-harvey/serverless-mini-agent-bump-version branch September 13, 2024 13:22
@duncanpharvey duncanpharvey changed the title Bump datadog-serverless-trace-mini-agent version to 0.7.0 [Serverless Mini Agent] Bump datadog-serverless-trace-mini-agent version to 0.7.0 Sep 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@jcstorms1 jcstorms1 jcstorms1 approved these changes

Assignees
No one assigned
Labels
mini-agent
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@duncanpharvey @codecov-commenter @jcstorms1