[Perf] Linux/x64: 4 Regressions on 10/18/2022 8:25:03 PM

[performanceautofiler]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	e8fa4a736d6bdcfbbe2c2dc1dd1303214bb97085
Compare	51e3afb2ba42609c3711cb50fb5eaa6800bc1fde
Diff	Diff

Regressions in System.IO.Tests.Perf_File

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ReadAllBytes - Duration of single invocation	8.03 μs	14.92 μs	1.86	0.27	False
CopyTo - Duration of single invocation	31.70 μs	47.28 μs	1.49	0.14	False
CopyTo - Duration of single invocation	30.86 μs	47.50 μs	1.54	0.11	False
ReadAllBytes - Duration of single invocation	8.34 μs	14.76 μs	1.77	0.20	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.IO.Tests.Perf_File*'

Related Issues

Regressions

• [Perf] Windows/x64: 4 Regressions on 10/18/2022 8:25:03 PM
• [Perf] Windows/x64: 4 Regressions on 10/18/2022 8:25:03 PM
• [Perf] Windows/x86: 2 Regressions on 10/18/2022 8:25:03 PM
• [Perf] Linux/arm64: 2 Regressions on 10/18/2022 8:25:03 PM

Improvements

• [Perf] Linux/x64: 8 Improvements on 10/18/2022 8:25:03 PM
• [Perf] Alpine/x64: 8 Improvements on 10/18/2022 8:25:03 PM
• [Perf] Linux/arm64: 3 Improvements on 10/18/2022 8:25:03 PM

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.IO.Tests.Perf_File.ReadAllBytes(size: 512)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 14.924441233027592 > 8.394361535978167.
IsChangePoint: Marked as a change because one of 9/7/2022 3:19:02 AM, 9/26/2022 7:45:50 PM, 10/18/2022 9:26:37 AM, 10/25/2022 8:17:52 AM falls between 10/16/2022 1:15:28 PM and 10/25/2022 8:17:52 AM.
IsRegressionStdDev: Marked as regression because -60.71352199521391 (T) = (0 -14413.039266632813) / Math.Sqrt((93647.87851033843 / (19)) + (155029.00381426577 / (25))) is less than -2.0180817028167235 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (25) - 2, .025) and -0.7998669786230697 = (8007.835822211176 - 14413.039266632813) / 8007.835822211176 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.Perf_File.CopyTo(size: 4096)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 47.277597728413646 > 33.13777048314447.
IsChangePoint: Marked as a change because one of 9/7/2022 3:19:02 AM, 10/18/2022 9:26:37 AM, 10/25/2022 8:17:52 AM falls between 10/16/2022 1:15:28 PM and 10/25/2022 8:17:52 AM.
IsRegressionStdDev: Marked as regression because -49.58415169741604 (T) = (0 -46979.61434923627) / Math.Sqrt((235323.85979796408 / (19)) + (2144672.296925887 / (25))) is less than -2.0180817028167235 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (25) - 2, .025) and -0.4940878695265783 = (31443.675641461694 - 46979.61434923627) / 31443.675641461694 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.Perf_File.CopyTo(size: 512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 47.500685832616185 > 32.42837908023321.
IsChangePoint: Marked as a change because one of 9/7/2022 8:46:47 AM, 10/18/2022 9:26:37 AM, 10/25/2022 8:17:52 AM falls between 10/16/2022 1:15:28 PM and 10/25/2022 8:17:52 AM.
IsRegressionStdDev: Marked as regression because -65.50936510262702 (T) = (0 -46525.14556955652) / Math.Sqrt((274538.68858025665 / (20)) + (988162.0125911582 / (25))) is less than -2.016692199226234 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (20) + (25) - 2, .025) and -0.4813271571741907 = (31407.74496992873 - 46525.14556955652) / 31407.74496992873 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.Perf_File.ReadAllBytes(size: 4096)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 14.759140554764166 > 8.903511269249764.
IsChangePoint: Marked as a change because one of 9/7/2022 8:46:47 AM, 9/26/2022 7:45:50 PM, 10/18/2022 9:26:37 AM, 10/25/2022 8:17:52 AM falls between 10/16/2022 1:15:28 PM and 10/25/2022 8:17:52 AM.
IsRegressionStdDev: Marked as regression because -52.64045446409999 (T) = (0 -14967.03827386326) / Math.Sqrt((164059.0304484875 / (19)) + (138689.80489963476 / (24))) is less than -2.019540970439573 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (24) - 2, .025) and -0.7308458599639482 = (8647.239260331944 - 14967.03827386326) / 8647.239260331944 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[radekdoulik]

Likely same issue as #9173