[Perf] Windows/arm64: 3 Regressions on 1/19/2023 1:09:52 AM

[performanceautofiler]

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	7392fb7c4617ee831d160f0c61aaf43038a6aba8
Compare	f429780c9ccce3546e9c9e25c05ed083318428bd
Diff	Diff

Regressions in System.Collections.Concurrent.Count<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Queue_EnqueueCountDequeue - Duration of single invocation	38.89 ns	41.90 ns	1.08	0.04	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Concurrent.Count<String>*'

Payloads

Baseline
Compare

Histogram

System.Collections.Concurrent.Count<String>.Queue_EnqueueCountDequeue(Size: 512)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 41.89816206417132 > 40.8445651257036.
IsChangePoint: Marked as a change because one of 1/13/2023 8:11:05 PM, 1/18/2023 8:37:25 PM, 1/26/2023 2:33:00 AM falls between 1/17/2023 11:08:46 AM and 1/26/2023 2:33:00 AM.
IsRegressionStdDev: Marked as regression because -14.325478327538084 (T) = (0 -41.50504599484297) / Math.Sqrt((0.36069832399584045 / (17)) + (0.32311039864723645 / (26))) is less than -2.019540970439573 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (17) + (26) - 2, .025) and -0.06758829201489287 = (38.877389631642735 - 41.50504599484297) / 38.877389631642735 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	7392fb7c4617ee831d160f0c61aaf43038a6aba8
Compare	f429780c9ccce3546e9c9e25c05ed083318428bd
Diff	Diff

Regressions in System.Collections.Tests.Add_Remove_SteadyState<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ConcurrentQueue - Duration of single invocation	25.29 ns	27.76 ns	1.10	0.13	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Tests.Add_Remove_SteadyState<String>*'

Payloads

Baseline
Compare

Histogram

System.Collections.Tests.Add_Remove_SteadyState<String>.ConcurrentQueue(Count: 512)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 27.75841410450402 > 26.672340572459014.
IsChangePoint: Marked as a change because one of 1/13/2023 9:23:19 AM, 1/18/2023 8:37:25 PM, 1/26/2023 2:33:00 AM falls between 1/17/2023 11:08:46 AM and 1/26/2023 2:33:00 AM.
IsRegressionStdDev: Marked as regression because -6.190932428195813 (T) = (0 -27.373707007301967) / Math.Sqrt((1.5340407649689112 / (17)) + (0.5560217509090876 / (26))) is less than -2.019540970439573 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (17) + (26) - 2, .025) and -0.08173752236113146 = (25.30531338836504 - 27.373707007301967) / 25.30531338836504 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	7392fb7c4617ee831d160f0c61aaf43038a6aba8
Compare	f429780c9ccce3546e9c9e25c05ed083318428bd
Diff	Diff

Regressions in System.Buffers.Tests.RentReturnArrayPoolTests<Byte>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
SingleParallel - Duration of single invocation	2.98 μs	3.20 μs	1.08	0.02	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Tests.RentReturnArrayPoolTests<Byte>*'

Payloads

Baseline
Compare

Histogram

System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: True)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 3.204738785714286 > 3.1247415675.
IsChangePoint: Marked as a change because one of 1/11/2023 5:39:19 AM, 1/13/2023 9:23:19 AM, 1/18/2023 8:37:25 PM, 1/26/2023 2:33:00 AM falls between 1/17/2023 11:08:46 AM and 1/26/2023 2:33:00 AM.
IsRegressionStdDev: Marked as regression because -37.72406144149934 (T) = (0 -3214.4514903212175) / Math.Sqrt((553.465871208559 / (17)) + (136.89649975405618 / (26))) is less than -2.019540970439573 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (17) + (26) - 2, .025) and -0.07778895162391196 = (2982.4498437082525 - 3214.4514903212175) / 2982.4498437082525 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[cincuranet]

@AndyAyersMS Could this be caused by dotnet/runtime#80769.
Commit range.