[Perf] Changes at 4/12/2022 9:40:49 PM

[performanceautofiler]

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	3635e0f355f8ba53d83f0677b5c56fc797e8d84d
Compare	f7d9d6d5f45b1ecdfa71a3faaaf26ffdca5bf468
Diff	Diff

Improvements in System.Tests.Perf_DateTime

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ToString - Duration of single invocation	43.62 ns	39.98 ns	0.92	0.08	False
ToString - Duration of single invocation	62.97 ns	59.16 ns	0.94	0.12	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_DateTime*'

Payloads

Baseline
Compare

Histogram

System.Tests.Perf_DateTime.ToString(format: "r")

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 39.981303150609804 < 41.50512604431112.
IsChangePoint: Marked as a change because one of 1/28/2022 4:34:00 PM, 4/12/2022 3:59:36 PM, 4/20/2022 10:05:23 PM falls between 4/12/2022 9:30:02 AM and 4/20/2022 10:05:23 PM.
IsImprovementStdDev: Marked as improvement because 36.29166888899447 (T) = (0 -40.16036909885626) / Math.Sqrt((1.1713405748655996 / (299)) + (0.28430136435314896 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.09468239493518969 = (44.360530353302075 - 40.16036909885626) / 44.360530353302075 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Tests.Perf_DateTime.ToString(format: "o")

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 59.15730977836239 < 59.77765482236109.
IsChangePoint: Marked as a change because one of 1/28/2022 4:34:00 PM, 4/12/2022 3:59:36 PM, 4/20/2022 10:05:23 PM falls between 4/12/2022 9:30:02 AM and 4/20/2022 10:05:23 PM.
IsImprovementStdDev: Marked as improvement because 29.508373577093007 (T) = (0 -59.34759075045974) / Math.Sqrt((5.426373759716075 / (299)) + (0.14561656541042725 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.07012191311419305 = (63.82298022444729 - 59.34759075045974) / 63.82298022444729 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	3635e0f355f8ba53d83f0677b5c56fc797e8d84d
Compare	f7d9d6d5f45b1ecdfa71a3faaaf26ffdca5bf468
Diff	Diff

Improvements in System.Buffers.Text.Tests.Utf8FormatterTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
FormatterDateTimeOffsetNow - Duration of single invocation	55.03 ns	50.44 ns	0.92	0.02	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Buffers.Text.Tests.Utf8FormatterTests*'

Payloads

Baseline
Compare

Histogram

System.Buffers.Text.Tests.Utf8FormatterTests.FormatterDateTimeOffsetNow(value: 12/30/2017 3:45:22 AM -08:00)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 50.44166211873143 < 52.24600541148548.
IsChangePoint: Marked as a change because one of 1/27/2022 1:01:32 PM, 3/22/2022 5:45:59 AM, 4/12/2022 3:59:36 PM, 4/20/2022 10:05:23 PM falls between 4/12/2022 9:30:02 AM and 4/20/2022 10:05:23 PM.
IsImprovementStdDev: Marked as improvement because 26.906643942999082 (T) = (0 -50.730207326656725) / Math.Sqrt((1.20013010048096 / (299)) + (0.2046317654603463 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.05231985899053291 = (53.53093847953699 - 50.730207326656725) / 53.53093847953699 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	3635e0f355f8ba53d83f0677b5c56fc797e8d84d
Compare	f7d9d6d5f45b1ecdfa71a3faaaf26ffdca5bf468
Diff	Diff

Improvements in System.Text.Json.Tests.Perf_DateTimes

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
WriteDateTimes - Duration of single invocation	6.63 ms	6.20 ms	0.94	0.00	False
WriteDateTimes - Duration of single invocation	7.16 ms	6.76 ms	0.94	0.00	False
WriteDateTimes - Duration of single invocation	6.50 ms	6.07 ms	0.93	0.00	False
WriteDateTimes - Duration of single invocation	7.31 ms	6.88 ms	0.94	0.00	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Tests.Perf_DateTimes*'

Payloads

Baseline
Compare

Histogram

System.Text.Json.Tests.Perf_DateTimes.WriteDateTimes(Formatted: False, SkipValidation: False)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 6.200917857142858 < 6.298702244444443.
IsChangePoint: Marked as a change because one of 1/28/2022 4:34:00 PM, 4/12/2022 3:59:36 PM, 4/20/2022 10:05:23 PM falls between 4/12/2022 9:30:02 AM and 4/20/2022 10:05:23 PM.
IsImprovementStdDev: Marked as improvement because 61.24538663757575 (T) = (0 -6215026.019708995) / Math.Sqrt((11137868850.468615 / (299)) + (396984014.21865153 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.06543545965579915 = (6650183.857200484 - 6215026.019708995) / 6650183.857200484 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_DateTimes.WriteDateTimes(Formatted: True, SkipValidation: True)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 6.760618378378378 < 6.805837828492936.
IsChangePoint: Marked as a change because one of 1/28/2022 4:34:00 PM, 4/12/2022 3:59:36 PM, 4/20/2022 10:05:23 PM falls between 4/12/2022 9:30:02 AM and 4/20/2022 10:05:23 PM.
IsImprovementStdDev: Marked as improvement because 59.32769606361011 (T) = (0 -6752964.487888988) / Math.Sqrt((17141303087.163496 / (299)) + (111014244.153169 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.06422491019350837 = (7216439.678134016 - 6752964.487888988) / 7216439.678134016 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_DateTimes.WriteDateTimes(Formatted: False, SkipValidation: True)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 6.066606829268292 < 6.172669538888887.
IsChangePoint: Marked as a change because one of 1/28/2022 4:34:00 PM, 4/12/2022 3:59:36 PM, 4/20/2022 10:05:23 PM falls between 4/12/2022 9:30:02 AM and 4/20/2022 10:05:23 PM.
IsImprovementStdDev: Marked as improvement because 54.27570470128932 (T) = (0 -6078059.824731444) / Math.Sqrt((13222326302.87416 / (299)) + (271935491.6702183 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.06119604707851864 = (6474258.87568647 - 6078059.824731444) / 6474258.87568647 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_DateTimes.WriteDateTimes(Formatted: True, SkipValidation: False)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 6.88327242063492 < 6.941766328431373.
IsChangePoint: Marked as a change because one of 1/28/2022 4:34:00 PM, 4/12/2022 3:59:36 PM, 4/20/2022 10:05:23 PM falls between 4/12/2022 9:30:02 AM and 4/20/2022 10:05:23 PM.
IsImprovementStdDev: Marked as improvement because 71.62245964139169 (T) = (0 -6884174.617131325) / Math.Sqrt((20165481962.713093 / (299)) + (56545822.6957605 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.07972071097029151 = (7480527.595475519 - 6884174.617131325) / 7480527.595475519 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	3635e0f355f8ba53d83f0677b5c56fc797e8d84d
Compare	f7d9d6d5f45b1ecdfa71a3faaaf26ffdca5bf468
Diff	Diff

Improvements in System.Numerics.Tests.Perf_BigInteger

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ModPow - Duration of single invocation	103.32 ns	97.32 ns	0.94	0.00	True
GreatestCommonDivisor - Duration of single invocation	7.37 μs	6.96 μs	0.94	0.00	True
GreatestCommonDivisor - Duration of single invocation	29.32 ns	27.44 ns	0.94	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_BigInteger*'

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_BigInteger.ModPow(arguments: 16,16,16 bits)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 97.32370073798015 < 98.13710641413958.
IsChangePoint: Marked as a change because one of 4/12/2022 3:59:36 PM, 4/20/2022 10:05:23 PM falls between 4/12/2022 9:30:02 AM and 4/20/2022 10:05:23 PM.
IsImprovementStdDev: Marked as improvement because 80.7935643254002 (T) = (0 -97.14399493813845) / Math.Sqrt((0.4618152457218907 / (299)) + (0.13237717804484092 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.060319620728387376 = (103.37982688692405 - 97.14399493813845) / 103.37982688692405 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_BigInteger.GreatestCommonDivisor(arguments: 1024,1024 bits)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 6.960522781240724 < 6.99535459175428.
IsChangePoint: Marked as a change because one of 4/12/2022 3:59:36 PM, 4/20/2022 10:05:23 PM falls between 4/12/2022 9:30:02 AM and 4/20/2022 10:05:23 PM.
IsImprovementStdDev: Marked as improvement because 192.91874536294478 (T) = (0 -6950.604882326105) / Math.Sqrt((1084.350393183135 / (299)) + (72.40726726879667 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.06385836689456494 = (7424.736425052552 - 6950.604882326105) / 7424.736425052552 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_BigInteger.GreatestCommonDivisor(arguments: 16,16 bits)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 27.44411484211953 < 27.920073950714553.
IsChangePoint: Marked as a change because one of 4/12/2022 3:59:36 PM, 4/20/2022 10:05:23 PM falls between 4/12/2022 9:30:02 AM and 4/20/2022 10:05:23 PM.
IsImprovementStdDev: Marked as improvement because 27.356134350228015 (T) = (0 -27.331001016569118) / Math.Sqrt((0.08559086746722536 / (299)) + (0.12508595735090278 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.06262866663288638 = (29.15706939574731 - 27.331001016569118) / 29.15706939574731 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	3635e0f355f8ba53d83f0677b5c56fc797e8d84d
Compare	f7d9d6d5f45b1ecdfa71a3faaaf26ffdca5bf468
Diff	Diff

Improvements in System.Tests.Perf_Int32

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
TryFormat - Duration of single invocation	15.20 ns	14.00 ns	0.92	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Int32*'

Payloads

Baseline
Compare

Histogram

System.Tests.Perf_Int32.TryFormat(value: 2147483647)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 13.996590360669835 < 14.184456558421294.
IsChangePoint: Marked as a change because one of 1/27/2022 1:01:32 PM, 1/28/2022 4:34:00 PM, 4/12/2022 3:59:36 PM, 4/20/2022 10:05:23 PM falls between 4/12/2022 9:30:02 AM and 4/20/2022 10:05:23 PM.
IsImprovementStdDev: Marked as improvement because 25.751839059322688 (T) = (0 -13.850788461708532) / Math.Sqrt((1.003672801428004 / (299)) + (0.04063770812661736 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.11317363994227758 = (15.6183770414842 - 13.850788461708532) / 15.6183770414842 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	3635e0f355f8ba53d83f0677b5c56fc797e8d84d
Compare	f7d9d6d5f45b1ecdfa71a3faaaf26ffdca5bf468
Diff	Diff

Improvements in System.Tests.Perf_Int64

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
TryFormat - Duration of single invocation	40.48 ns	38.13 ns	0.94	0.07	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Int64*'

Payloads

Baseline
Compare

Histogram

System.Tests.Perf_Int64.TryFormat(value: 9223372036854775807)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 38.130310975456155 < 38.835281120363.
IsChangePoint: Marked as a change because one of 1/28/2022 4:34:00 PM, 4/12/2022 3:59:36 PM, 4/20/2022 10:05:23 PM falls between 4/12/2022 9:30:02 AM and 4/20/2022 10:05:23 PM.
IsImprovementStdDev: Marked as improvement because 39.12277141466285 (T) = (0 -37.89893552189278) / Math.Sqrt((1.6011632061682377 / (299)) + (0.06763383797157387 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.08261046640147036 = (41.31171561684528 - 37.89893552189278) / 41.31171561684528 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	3635e0f355f8ba53d83f0677b5c56fc797e8d84d
Compare	f7d9d6d5f45b1ecdfa71a3faaaf26ffdca5bf468
Diff	Diff

Improvements in System.Tests.Perf_UInt32

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
TryFormat - Duration of single invocation	6.90 ns	5.79 ns	0.84	0.37	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_UInt32*'

Payloads

Baseline
Compare

Histogram

System.Tests.Perf_UInt32.TryFormat(value: 12345)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 5.791014858456084 < 6.547879325030964.
IsChangePoint: Marked as a change because one of 1/27/2022 1:01:32 PM, 1/28/2022 4:34:00 PM, 4/12/2022 3:59:36 PM, 4/20/2022 10:05:23 PM falls between 4/12/2022 9:30:02 AM and 4/20/2022 10:05:23 PM.
IsImprovementStdDev: Marked as improvement because 12.557364403593331 (T) = (0 -6.135752731438879) / Math.Sqrt((0.6206986597237139 / (299)) + (0.12592863743906582 / (30))) is greater than 1.9672451058622664 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (30) - 2, .975) and 0.13948991977355685 = (7.130367060690627 - 6.135752731438879) / 7.130367060690627 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	3635e0f355f8ba53d83f0677b5c56fc797e8d84d
Compare	f7d9d6d5f45b1ecdfa71a3faaaf26ffdca5bf468
Diff	Diff

Improvements in System.Tests.Perf_UInt64

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
TryFormat - Duration of single invocation	42.60 ns	39.20 ns	0.92	0.12	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_UInt64*'

Payloads

Baseline
Compare

Histogram

System.Tests.Perf_UInt64.TryFormat(value: 18446744073709551615)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 39.203108318814415 < 40.28763334699423.
IsChangePoint: Marked as a change because one of 1/28/2022 4:34:00 PM, 4/12/2022 3:59:36 PM, 4/20/2022 10:05:23 PM falls between 4/12/2022 9:30:02 AM and 4/20/2022 10:05:23 PM.
IsImprovementStdDev: Marked as improvement because 25.0079672195691 (T) = (0 -38.87704661735574) / Math.Sqrt((1.8492905697665656 / (299)) + (0.09421387102398832 / (6))) is greater than 1.967824097752068 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (6) - 2, .975) and 0.0868961805122205 = (42.57680866910014 - 38.87704661735574) / 42.57680866910014 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository