[Perf] Alpine/x64: 3 Regressions on 10/31/2022 10:23:25 PM

[performanceautofiler]

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	3d9d78c63c5ad9a2ed15b2c863f989a8cef2a8b9
Compare	7d5efbb9e10b6d8beb91c90cbdefd7360869cece
Diff	Diff

Regressions in System.Collections.IndexerSetReverse<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
IList - Duration of single invocation	899.76 ns	1.02 μs	1.14	0.03	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.IndexerSetReverse<Int32>*'

Related Issues

Regressions

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Collections.IndexerSetReverse<Int32>.IList(Size: 512)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 1.021742881967213 > 944.8608030602201.
IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/9/2022 6:38:34 PM, 10/11/2022 8:42:28 PM, 10/19/2022 7:27:15 PM, 10/31/2022 4:38:04 PM, 11/1/2022 10:15:31 AM falls between 10/23/2022 1:14:54 PM and 11/1/2022 10:15:31 AM.
IsRegressionStdDev: Marked as regression because -22.928225608176742 (T) = (0 -1021.9083753103173) / Math.Sqrt((1149.8858095198607 / (50)) + (0.05477609322366702 / (2))) is less than -2.0085591120996775 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (50) + (2) - 2, .025) and -0.12065061007082259 = (911.8884745404591 - 1021.9083753103173) / 911.8884745404591 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	x64
OS	alpine 3.15
Baseline	3d9d78c63c5ad9a2ed15b2c863f989a8cef2a8b9
Compare	7d5efbb9e10b6d8beb91c90cbdefd7360869cece
Diff	Diff

Regressions in System.MathBenchmarks.Single

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Max - Duration of single invocation	4.35 μs	5.44 μs	1.25	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.MathBenchmarks.Single*'

Related Issues

Regressions

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.MathBenchmarks.Single.Max

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 5.441834200737892 > 4.572465414462472.
IsChangePoint: Marked as a change because one of 10/25/2022 2:34:53 PM, 10/26/2022 7:11:30 AM, 10/31/2022 4:38:04 PM, 11/1/2022 10:15:31 AM falls between 10/23/2022 1:14:54 PM and 11/1/2022 10:15:31 AM.
IsRegressionStdDev: Marked as regression because -23.739333958606704 (T) = (0 -5441.469801618846) / Math.Sqrt((88527.65713014967 / (50)) + (0.26557343592378674 / (2))) is less than -2.0085591120996775 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (50) + (2) - 2, .025) and -0.22485830083394873 = (4442.53004442555 - 5441.469801618846) / 4442.53004442555 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	alpine 3.15
Baseline	3d9d78c63c5ad9a2ed15b2c863f989a8cef2a8b9
Compare	7d5efbb9e10b6d8beb91c90cbdefd7360869cece
Diff	Diff

Regressions in System.Tests.Perf_String

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Trim_CharArr - Duration of single invocation	3.74 ns	5.00 ns	1.34	0.05	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_String*'

Related Issues

Regressions

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Tests.Perf_String.Trim_CharArr(s: "Test", c: [' ', ' '])

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 5.002519916013978 > 3.940252086315029.
IsChangePoint: Marked as a change because one of 9/13/2022 12:23:36 PM, 9/23/2022 1:16:35 AM, 9/29/2022 7:42:19 AM, 10/2/2022 4:08:26 PM, 10/11/2022 8:42:28 PM, 10/19/2022 7:27:15 PM, 10/31/2022 4:38:04 PM, 11/1/2022 10:15:31 AM falls between 10/23/2022 1:14:54 PM and 11/1/2022 10:15:31 AM.
IsRegressionStdDev: Marked as regression because -22.471897446481076 (T) = (0 -4.997882825723496) / Math.Sqrt((0.12792043479232243 / (50)) + (4.300521272415631E-05 / (2))) is less than -2.0085591120996775 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (50) + (2) - 2, .025) and -0.2959729301411838 = (3.85647162026681 - 4.997882825723496) / 3.85647162026681 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository