[Perf] Windows/x86: 3 Improvements on 10/31/2022 10:23:25 PM

[performanceautofiler]

Run Information

Architecture	x86
OS	Windows 10.0.18362
Baseline	3dbc850af3e8bfd6d529ed90cf00247dc9a24512
Compare	7d5efbb9e10b6d8beb91c90cbdefd7360869cece
Diff	Diff

Improvements in System.Numerics.Tests.Perf_Vector3

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
MultiplyByScalarBenchmark - Duration of single invocation	7.43 ns	0.00 ns	0.00	0.15	False
NegateBenchmark - Duration of single invocation	7.40 ns	0.04 ns	0.01	0.10	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_Vector3*'

Related Issues

Regressions

• [Perf] Windows/x86: 1 Regression on 10/31/2022 10:23:25 PM
• [Perf] Linux/x64: 4 Regressions on 10/31/2022 10:23:25 PM
• [Perf] Alpine/x64: 3 Regressions on 10/31/2022 10:23:25 PM

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Numerics.Tests.Perf_Vector3.MultiplyByScalarBenchmark

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0 < 7.061129368434262.
IsChangePoint: Marked as a change because one of 10/31/2022 1:09:40 PM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsImprovementStdDev: Marked as improvement because 714.466915887151 (T) = (0 -0.00736002305327859) / Math.Sqrt((0.027022346771284646 / (299)) + (0.00026597337992283085 / (29))) is greater than 1.9672675222597202 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (29) - 2, .975) and 0.9989685830238778 = (7.135836643827988 - 0.00736002305327859) / 7.135836643827988 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_Vector3.NegateBenchmark

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.04276737282228183 < 6.939500771368217.
IsChangePoint: Marked as a change because one of 10/31/2022 1:09:40 PM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsImprovementStdDev: Marked as improvement because 651.1682173385148 (T) = (0 -0.021211481240859597) / Math.Sqrt((0.03400161548659803 / (299)) + (0.0002225846704967983 / (29))) is greater than 1.9672675222597202 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (29) - 2, .975) and 0.9970521955129202 = (7.195687954825382 - 0.021211481240859597) / 7.195687954825382 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	x86
OS	Windows 10.0.18362
Baseline	3dbc850af3e8bfd6d529ed90cf00247dc9a24512
Compare	7d5efbb9e10b6d8beb91c90cbdefd7360869cece
Diff	Diff

Improvements in System.Numerics.Tests.Perf_Vector2

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
DivideByScalarBenchmark - Duration of single invocation	9.60 ns	0.00 ns	0.00	0.06	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_Vector2*'

Related Issues

Regressions

• [Perf] Windows/x86: 1 Regression on 10/31/2022 10:23:25 PM
• [Perf] Linux/x64: 4 Regressions on 10/31/2022 10:23:25 PM
• [Perf] Alpine/x64: 3 Regressions on 10/31/2022 10:23:25 PM

Improvements

• [Perf] Linux/x64: 1 Improvement on 10/31/2022 10:23:25 PM

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Numerics.Tests.Perf_Vector2.DivideByScalarBenchmark

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0 < 9.11428736130013.
IsChangePoint: Marked as a change because one of 10/31/2022 1:09:40 PM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsImprovementStdDev: Marked as improvement because 2052.011429060821 (T) = (0 -0.030970963381250147) / Math.Sqrt((0.0032589990740082846 / (299)) + (0.0003191919963586642 / (29))) is greater than 1.9672675222597202 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (29) - 2, .975) and 0.9967856558615086 = (9.63523569563575 - 0.030970963381250147) / 9.63523569563575 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository