[Perf] Linux/x64: 3 Regressions on 1/31/2023 8:24:06 AM

[performanceautofiler]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	b5e79f56d1ed06dbf6765b29c021726ff4195e91
Compare	7c4b59ccf2cfc74c54e6c8922ab80cda20c3a55e
Diff	Diff

Regressions in System.IO.Tests.Perf_File

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
WriteAllBytes - Duration of single invocation	20.96 μs	24.38 μs	1.16	0.26	False
Delete - Duration of single invocation	14.44 μs	15.72 μs	1.09	0.12	False
WriteAllBytes - Duration of single invocation	16.64 μs	20.21 μs	1.21	0.23	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.IO.Tests.Perf_File*'

Payloads

Baseline
Compare

Histogram

System.IO.Tests.Perf_File.WriteAllBytes(size: 16384)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 24.380298815993793 > 21.489482636198503.
IsChangePoint: Marked as a change because one of 11/23/2022 9:29:54 AM, 1/30/2023 9:42:46 PM, 2/7/2023 2:48:42 AM falls between 1/29/2023 12:56:15 AM and 2/7/2023 2:48:42 AM.
IsRegressionStdDev: Marked as regression because -15.482008122134875 (T) = (0 -23807.874664275194) / Math.Sqrt((971806.37777805 / (24)) + (388967.19125506683 / (37))) is less than -2.000995378087428 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (37) - 2, .025) and -0.17214411213323713 = (20311.388691742166 - 23807.874664275194) / 20311.388691742166 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.Perf_File.Delete

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 15.716666666666667 > 15.153115661764707.
IsChangePoint: Marked as a change because one of 2/1/2023 12:50:52 AM, 2/7/2023 2:48:42 AM falls between 1/29/2023 12:56:15 AM and 2/7/2023 2:48:42 AM.
IsRegressionStdDev: Marked as regression because -26.302187290833057 (T) = (0 -17955.716204554737) / Math.Sqrt((174861.4237038132 / (28)) + (349082.0662027882 / (32))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (28) + (32) - 2, .025) and -0.23739968179943738 = (14510.845985060687 - 17955.716204554737) / 14510.845985060687 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.IO.Tests.Perf_File.WriteAllBytes(size: 4096)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 20.212484045493195 > 17.287758512351978.
IsChangePoint: Marked as a change because one of 11/23/2022 9:29:54 AM, 1/30/2023 9:42:46 PM, 2/7/2023 2:48:42 AM falls between 1/29/2023 12:56:15 AM and 2/7/2023 2:48:42 AM.
IsRegressionStdDev: Marked as regression because -26.814784951937035 (T) = (0 -19407.19405469798) / Math.Sqrt((125508.44879945827 / (23)) + (218283.7653582212 / (37))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (23) + (37) - 2, .025) and -0.17266617605393655 = (16549.63232588824 - 19407.19405469798) / 16549.63232588824 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository