[Perf] Windows/x86: 30 Regressions on 11/2/2022 4:25:40 PM

[performanceautofiler]

Run Information

Architecture	x86
OS	Windows 10.0.18362
Baseline	d3a3eda6f4660e85f7a603b624b43993529be377
Compare	fbc20578253e0deb7267eea5a02b680c3cfe0e2a
Diff	Diff

Regressions in System.Numerics.Tests.Perf_VectorOf<UInt32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
OnesComplementOperatorBenchmark - Duration of single invocation	0.35 ns	10.23 ns	29.17	0.10	False
OnesComplementBenchmark - Duration of single invocation	0.35 ns	9.92 ns	28.28	0.25	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_VectorOf<UInt32>*'

Related Issues

Regressions

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Numerics.Tests.Perf_VectorOf<UInt32>.OnesComplementOperatorBenchmark

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 10.232853187028917 > 0.3682951914384786.
IsChangePoint: Marked as a change because one of 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -239.87499158472266 (T) = (0 -10.099243376366788) / Math.Sqrt((1.0495633287414307E-05 / (31)) + (0.03136813506749971 / (19))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (19) - 2, .025) and -27.71893677956053 = (0.35165798281064814 - 10.099243376366788) / 0.35165798281064814 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_VectorOf<UInt32>.OnesComplementBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 9.920666468642251 > 0.3683458647212298.
IsChangePoint: Marked as a change because one of 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -223.08780257821465 (T) = (0 -10.088546084752902) / Math.Sqrt((1.518183988373323E-05 / (31)) + (0.0361831398766661 / (19))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (19) - 2, .025) and -27.666233276382382 = (0.35193134680393057 - 10.088546084752902) / 0.35193134680393057 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	x86
OS	Windows 10.0.18362
Baseline	d3a3eda6f4660e85f7a603b624b43993529be377
Compare	fbc20578253e0deb7267eea5a02b680c3cfe0e2a
Diff	Diff

Regressions in System.Numerics.Tests.Perf_VectorOf<Byte>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
OnesComplementBenchmark - Duration of single invocation	0.35 ns	9.92 ns	28.16	0.25	False
OnesComplementOperatorBenchmark - Duration of single invocation	0.35 ns	9.92 ns	28.16	0.12	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_VectorOf<Byte>*'

Related Issues

Regressions

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Numerics.Tests.Perf_VectorOf<Byte>.OnesComplementBenchmark

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 9.919990507952027 > 0.3684033442029486.
IsChangePoint: Marked as a change because one of 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -251.53719064957235 (T) = (0 -10.028436084932789) / Math.Sqrt((4.5620299729594605E-07 / (31)) + (0.028122187288692486 / (19))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (19) - 2, .025) and -27.55617941123143 = (0.3511826964145107 - 10.028436084932789) / 0.3511826964145107 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_VectorOf<Byte>.OnesComplementOperatorBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 9.919659263496312 > 0.36840275668755323.
IsChangePoint: Marked as a change because one of 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -238.03575362909368 (T) = (0 -9.997381041296865) / Math.Sqrt((3.8728034663135453E-07 / (31)) + (0.0312018458304494 / (19))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (19) - 2, .025) and -27.469552543925435 = (0.3511604555734408 - 9.997381041296865) / 0.3511604555734408 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x86
OS	Windows 10.0.18362
Baseline	d3a3eda6f4660e85f7a603b624b43993529be377
Compare	fbc20578253e0deb7267eea5a02b680c3cfe0e2a
Diff	Diff

Regressions in System.Numerics.Tests.Perf_VectorOf<Double>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
OnesComplementBenchmark - Duration of single invocation	0.35 ns	10.21 ns	29.12	0.25	False
EqualsBenchmark - Duration of single invocation	0.81 ns	12.48 ns	15.47	0.08	False
OnesComplementOperatorBenchmark - Duration of single invocation	0.35 ns	10.31 ns	29.40	0.11	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_VectorOf<Double>*'

Related Issues

Regressions

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Numerics.Tests.Perf_VectorOf<Double>.OnesComplementBenchmark

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 10.212588828844682 > 0.36831785229104136.
IsChangePoint: Marked as a change because one of 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -246.75154480180652 (T) = (0 -10.072989986396268) / Math.Sqrt((3.113583446549675E-07 / (31)) + (0.029494342140933702 / (19))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (19) - 2, .025) and -27.695547288150706 = (0.35102972197208177 - 10.072989986396268) / 0.35102972197208177 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_VectorOf<Double>.EqualsBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 12.476559503640553 > 0.8469036278313005.
IsChangePoint: Marked as a change because one of 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -343.4939786745 (T) = (0 -12.291401516624575) / Math.Sqrt((0.0005088788718934147 / (31)) + (0.020938782636762483 / (19))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (19) - 2, .025) and -14.291285611838616 = (0.8038174048039812 - 12.291401516624575) / 0.8038174048039812 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_VectorOf<Double>.OnesComplementOperatorBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 10.314355237097585 > 0.3683554492318309.
IsChangePoint: Marked as a change because one of 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -226.2317580247239 (T) = (0 -10.122614428772772) / Math.Sqrt((7.485072758264043E-06 / (31)) + (0.035438785396535825 / (19))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (19) - 2, .025) and -27.79869046157266 = (0.35149565020256096 - 10.122614428772772) / 0.35149565020256096 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x86
OS	Windows 10.0.18362
Baseline	d3a3eda6f4660e85f7a603b624b43993529be377
Compare	fbc20578253e0deb7267eea5a02b680c3cfe0e2a
Diff	Diff

Regressions in System.Numerics.Tests.Perf_VectorOf<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
OnesComplementOperatorBenchmark - Duration of single invocation	0.45 ns	10.24 ns	22.83	0.09	False
OnesComplementBenchmark - Duration of single invocation	0.35 ns	9.92 ns	28.28	0.25	False
SquareRootBenchmark - Duration of single invocation	18.51 ns	20.50 ns	1.11	0.04	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_VectorOf<Int32>*'

Related Issues

Regressions

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Numerics.Tests.Perf_VectorOf<Int32>.OnesComplementOperatorBenchmark

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 10.237169950584947 > 0.3691557928810883.
IsChangePoint: Marked as a change because one of 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -225.62876354228246 (T) = (0 -10.057134875937658) / Math.Sqrt((0.0003108741744081932 / (31)) + (0.034944957751987735 / (19))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (19) - 2, .025) and -27.371709416617506 = (0.3544775793469506 - 10.057134875937658) / 0.3544775793469506 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_VectorOf<Int32>.OnesComplementBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 9.91955282620574 > 0.3683046115678106.
IsChangePoint: Marked as a change because one of 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -243.46825270061078 (T) = (0 -10.077341660173582) / Math.Sqrt((1.8210017835673E-06 / (31)) + (0.030319953517507128 / (19))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (19) - 2, .025) and -27.688914764313235 = (0.3512625605730129 - 10.077341660173582) / 0.3512625605730129 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_VectorOf<Int32>.SquareRootBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 20.50154013343025 > 19.386174653741755.
IsChangePoint: Marked as a change because one of 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -32.11382280287923 (T) = (0 -20.263139769141354) / Math.Sqrt((0.04573048603154225 / (31)) + (0.04739048984668227 / (19))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (19) - 2, .025) and -0.11092605790998478 = (18.239863602860254 - 20.263139769141354) / 18.239863602860254 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x86
OS	Windows 10.0.18362
Baseline	d3a3eda6f4660e85f7a603b624b43993529be377
Compare	fbc20578253e0deb7267eea5a02b680c3cfe0e2a
Diff	Diff

Regressions in System.Linq.Tests.Perf_Enumerable

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
WhereSingleOrDefault_LastElementMatches - Duration of single invocation	325.36 ns	388.18 ns	1.19	0.04	False
Select - Duration of single invocation	798.47 ns	891.91 ns	1.12	0.03	False
FirstWithPredicate_LastElementMatches - Duration of single invocation	985.50 ns	1.05 μs	1.06	0.02	False
Select - Duration of single invocation	1.12 μs	1.21 μs	1.08	0.01	False
WhereSingleOrDefault_LastElementMatches - Duration of single invocation	753.84 ns	811.56 ns	1.08	0.02	False
WhereFirst_LastElementMatches - Duration of single invocation	719.54 ns	762.78 ns	1.06	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Linq.Tests.Perf_Enumerable*'

Related Issues

Regressions

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Linq.Tests.Perf_Enumerable.WhereSingleOrDefault_LastElementMatches(input: Array)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 388.1762834942391 > 341.33331817713974.
IsChangePoint: Marked as a change because one of 9/9/2022 3:12:19 AM, 9/15/2022 1:09:14 PM, 9/23/2022 1:16:35 AM, 10/2/2022 11:57:04 PM, 10/19/2022 7:27:15 PM, 10/26/2022 7:11:30 AM, 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -224.5179500119383 (T) = (0 -386.6338686272019) / Math.Sqrt((0.9308831490833372 / (31)) + (0.8677928344754632 / (19))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (19) - 2, .025) and -0.19015502092229022 = (324.8600911901263 - 386.6338686272019) / 324.8600911901263 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Linq.Tests.Perf_Enumerable.Select(input: List)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 891.9098076813004 > 837.31191760236.
IsChangePoint: Marked as a change because one of 8/27/2022 12:34:40 AM, 9/26/2022 8:26:31 AM, 10/19/2022 7:27:15 PM, 10/25/2022 12:27:43 PM, 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -30.868250013890737 (T) = (0 -866.540415535576) / Math.Sqrt((11.093248047381715 / (31)) + (83.7078089020045 / (19))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (19) - 2, .025) and -0.08430191637837313 = (799.1689421981912 - 866.540415535576) / 799.1689421981912 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Linq.Tests.Perf_Enumerable.FirstWithPredicate_LastElementMatches(input: List)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 1.0468959900591077 > 1034.7795407060016.
IsChangePoint: Marked as a change because one of 8/24/2022 2:39:26 AM, 8/27/2022 12:34:40 AM, 9/26/2022 8:26:31 AM, 10/19/2022 7:27:15 PM, 10/25/2022 2:34:53 PM, 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -72.54341340199926 (T) = (0 -1046.1378427173622) / Math.Sqrt((2.4376557657731506 / (31)) + (11.465599916147882 / (19))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (19) - 2, .025) and -0.060749349805875895 = (986.2252971531987 - 1046.1378427173622) / 986.2252971531987 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Linq.Tests.Perf_Enumerable.Select(input: IList)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 1.2128833255645326 > 1.1733245613714787.
IsChangePoint: Marked as a change because one of 8/27/2022 12:34:40 AM, 9/26/2022 8:26:31 AM, 10/25/2022 12:27:43 PM, 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -61.70660160744853 (T) = (0 -1212.4633446828693) / Math.Sqrt((9.207804049105606 / (31)) + (38.798075478781314 / (19))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (19) - 2, .025) and -0.08440589274675023 = (1118.0899631702991 - 1212.4633446828693) / 1118.0899631702991 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Linq.Tests.Perf_Enumerable.WhereSingleOrDefault_LastElementMatches(input: IEnumerable)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 811.5556800806227 > 790.6306510161276.
IsChangePoint: Marked as a change because one of 10/2/2022 11:57:04 PM, 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -78.42687722132564 (T) = (0 -812.2675529889704) / Math.Sqrt((4.146859849610885 / (31)) + (8.852412342676736 / (19))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (19) - 2, .025) and -0.08081242551990057 = (751.5342475807005 - 812.2675529889704) / 751.5342475807005 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Linq.Tests.Perf_Enumerable.WhereFirst_LastElementMatches(input: IEnumerable)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 762.7764646811012 > 751.1322871210074.
IsChangePoint: Marked as a change because one of 10/3/2022 1:11:02 PM, 10/6/2022 2:13:23 PM, 10/19/2022 7:27:15 PM, 10/25/2022 12:27:43 PM, 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -61.028639171858835 (T) = (0 -763.033356164663) / Math.Sqrt((7.142750166448125 / (31)) + (6.85269152188829 / (19))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (19) - 2, .025) and -0.06552011958756862 = (716.1135131451208 - 763.033356164663) / 716.1135131451208 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x86
OS	Windows 10.0.18362
Baseline	d3a3eda6f4660e85f7a603b624b43993529be377
Compare	fbc20578253e0deb7267eea5a02b680c3cfe0e2a
Diff	Diff

Regressions in System.Numerics.Tests.Perf_VectorOf<SByte>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
OnesComplementOperatorBenchmark - Duration of single invocation	0.35 ns	10.27 ns	29.29	0.08	False
OnesComplementBenchmark - Duration of single invocation	0.35 ns	10.37 ns	29.55	0.13	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_VectorOf<SByte>*'

Related Issues

Regressions

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Numerics.Tests.Perf_VectorOf<SByte>.OnesComplementOperatorBenchmark

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 10.27405148731388 > 0.3683583403013838.
IsChangePoint: Marked as a change because one of 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -244.45613805937222 (T) = (0 -10.06952659278593) / Math.Sqrt((7.060681308198053E-06 / (31)) + (0.030021518045891236 / (19))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (19) - 2, .025) and -27.635791828319867 = (0.3516412835082666 - 10.06952659278593) / 0.3516412835082666 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_VectorOf<SByte>.OnesComplementBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 10.368093945301476 > 0.3683620730802239.
IsChangePoint: Marked as a change because one of 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -221.97446660066907 (T) = (0 -10.100202914997531) / Math.Sqrt((1.4208390662419122E-06 / (31)) + (0.03664830970184221 / (19))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (19) - 2, .025) and -27.755727995241386 = (0.35124142628797134 - 10.100202914997531) / 0.35124142628797134 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x86
OS	Windows 10.0.18362
Baseline	d3a3eda6f4660e85f7a603b624b43993529be377
Compare	fbc20578253e0deb7267eea5a02b680c3cfe0e2a
Diff	Diff

Regressions in System.Numerics.Tests.Perf_VectorOf<UInt16>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
OnesComplementOperatorBenchmark - Duration of single invocation	0.35 ns	9.92 ns	28.25	0.30	False
OnesComplementBenchmark - Duration of single invocation	0.35 ns	9.92 ns	28.44	0.06	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_VectorOf<UInt16>*'

Related Issues

Regressions

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Numerics.Tests.Perf_VectorOf<UInt16>.OnesComplementOperatorBenchmark

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 9.920443412682918 > 0.3683201030079756.
IsChangePoint: Marked as a change because one of 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -249.64798071414197 (T) = (0 -10.00412786154018) / Math.Sqrt((2.0492913549376778E-07 / (31)) + (0.02840768000393018 / (19))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (19) - 2, .025) and -27.505475044049934 = (0.35095460945943374 - 10.00412786154018) / 0.35095460945943374 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_VectorOf<UInt16>.OnesComplementBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 9.918218042171077 > 0.3683095608222839.
IsChangePoint: Marked as a change because one of 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -223.14525618400833 (T) = (0 -10.079122704829096) / Math.Sqrt((3.6573315413853704E-07 / (31)) + (0.0361114200629665 / (19))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (19) - 2, .025) and -27.725439801920857 = (0.350877924736077 - 10.079122704829096) / 0.350877924736077 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x86
OS	Windows 10.0.18362
Baseline	d3a3eda6f4660e85f7a603b624b43993529be377
Compare	fbc20578253e0deb7267eea5a02b680c3cfe0e2a
Diff	Diff

Regressions in System.Numerics.Tests.Perf_VectorConvert

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Convert_float_uint - Duration of single invocation	21.42 μs	24.09 μs	1.12	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_VectorConvert*'

Related Issues

Regressions

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Numerics.Tests.Perf_VectorConvert.Convert_float_uint

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 24.090204999678683 > 21.995298670247877.
IsChangePoint: Marked as a change because one of 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -29.18149240574193 (T) = (0 -24220.03409285443) / Math.Sqrt((248324.77542410404 / (21)) + (22653.184411918824 / (19))) is less than -2.0243941639098457 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (19) - 2, .025) and -0.1593734292628975 = (20890.62374687417 - 24220.03409285443) / 20890.62374687417 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[performanceautofiler]

Run Information

Architecture	x86
OS	Windows 10.0.18362
Baseline	d3a3eda6f4660e85f7a603b624b43993529be377
Compare	fbc20578253e0deb7267eea5a02b680c3cfe0e2a
Diff	Diff

Regressions in System.Numerics.Tests.Perf_VectorOf<Int64>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
OnesComplementOperatorBenchmark - Duration of single invocation	0.35 ns	9.92 ns	28.28	0.11	False
OnesComplementBenchmark - Duration of single invocation	0.35 ns	9.92 ns	28.28	0.26	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_VectorOf<Int64>*'

Related Issues

Regressions

• [Perf] Alpine/x64: 18 Regressions on 11/2/2022 4:25:40 PM

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Numerics.Tests.Perf_VectorOf<Int64>.OnesComplementOperatorBenchmark

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 9.92039360555122 > 0.3683331603451809.
IsChangePoint: Marked as a change because one of 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -224.74146482042067 (T) = (0 -10.086372074677694) / Math.Sqrt((6.751115160724935E-06 / (31)) + (0.03564528527537348 / (19))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (19) - 2, .025) and -27.699638438012755 = (0.3514459632117966 - 10.086372074677694) / 0.3514459632117966 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_VectorOf<Int64>.OnesComplementBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 9.921602121285098 > 0.36835364291067324.
IsChangePoint: Marked as a change because one of 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -237.49763430685837 (T) = (0 -10.093346450020773) / Math.Sqrt((2.4900798840902217E-06 / (31)) + (0.031971813589556856 / (19))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (19) - 2, .025) and -27.779736064471457 = (0.35071018119867314 - 10.093346450020773) / 0.35071018119867314 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	x86
OS	Windows 10.0.18362
Baseline	d3a3eda6f4660e85f7a603b624b43993529be377
Compare	fbc20578253e0deb7267eea5a02b680c3cfe0e2a
Diff	Diff

Regressions in Span.Sorting

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
BubbleSortArray - Duration of single invocation	198.15 μs	211.12 μs	1.07	0.03	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Span.Sorting*'

Related Issues

Regressions

• [Perf] Linux/x64: 15 Regressions on 11/2/2022 4:25:40 PM
• [Perf] Alpine/x64: 18 Regressions on 11/2/2022 4:25:40 PM

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

Span.Sorting.BubbleSortArray(Size: 512)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 211.11608 > 208.032437.
IsChangePoint: Marked as a change because one of 9/9/2022 3:12:19 AM, 9/13/2022 12:23:36 PM, 9/20/2022 10:35:57 PM, 10/11/2022 5:13:36 PM, 10/26/2022 7:11:30 AM, 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -81.5247568896223 (T) = (0 -212704.81566416044) / Math.Sqrt((126977.34682233952 / (31)) + (515275.3505938621 / (19))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (19) - 2, .025) and -0.07263597572377141 = (198301.02707550512 - 212704.81566416044) / 198301.02707550512 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x86
OS	Windows 10.0.18362
Baseline	d3a3eda6f4660e85f7a603b624b43993529be377
Compare	fbc20578253e0deb7267eea5a02b680c3cfe0e2a
Diff	Diff

Regressions in System.Numerics.Tests.Perf_VectorOf<UInt64>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
OnesComplementBenchmark - Duration of single invocation	0.35 ns	10.23 ns	29.17	0.21	False
OnesComplementOperatorBenchmark - Duration of single invocation	0.35 ns	10.32 ns	29.42	0.10	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_VectorOf<UInt64>*'

Related Issues

Regressions

• [Perf] Linux/x64: 15 Regressions on 11/2/2022 4:25:40 PM
• [Perf] Alpine/x64: 18 Regressions on 11/2/2022 4:25:40 PM

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Numerics.Tests.Perf_VectorOf<UInt64>.OnesComplementBenchmark

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 10.233286778617927 > 0.3683721300476585.
IsChangePoint: Marked as a change because one of 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -231.8697707477859 (T) = (0 -10.074356840484496) / Math.Sqrt((4.94472762273931E-07 / (30)) + (0.03340963112925549 / (19))) is less than -2.011740513728388 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (30) + (19) - 2, .025) and -27.681717143888363 = (0.3512466422405671 - 10.074356840484496) / 0.3512466422405671 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_VectorOf<UInt64>.OnesComplementOperatorBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 10.319755526305062 > 0.36834001866385135.
IsChangePoint: Marked as a change because one of 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -217.1281434797785 (T) = (0 -10.06205468106468) / Math.Sqrt((4.797738553698602E-07 / (30)) + (0.03800400025171031 / (19))) is less than -2.011740513728388 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (30) + (19) - 2, .025) and -27.64731598889242 = (0.3512390021098694 - 10.06205468106468) / 0.3512390021098694 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x86
OS	Windows 10.0.18362
Baseline	4ad19b10efabbbf8de5a38185bf3402661e01a5a
Compare	fbc20578253e0deb7267eea5a02b680c3cfe0e2a
Diff	Diff

Regressions in System.Numerics.Tests.Perf_VectorOf<Single>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
OnesComplementBenchmark - Duration of single invocation	0.35 ns	9.92 ns	28.16	0.23	False
OnesComplementOperatorBenchmark - Duration of single invocation	0.35 ns	10.24 ns	29.05	0.09	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_VectorOf<Single>*'

Related Issues

Regressions

• [Perf] Linux/x64: 15 Regressions on 11/2/2022 4:25:40 PM
• [Perf] Alpine/x64: 18 Regressions on 11/2/2022 4:25:40 PM

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Numerics.Tests.Perf_VectorOf<Single>.OnesComplementBenchmark

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 9.919990201582301 > 0.36908562455609806.
IsChangePoint: Marked as a change because one of 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -200.972968404727 (T) = (0 -10.064423664293889) / Math.Sqrt((1.5931494035462568E-05 / (30)) + (0.04436441319047099 / (19))) is less than -2.011740513728388 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (30) + (19) - 2, .025) and -27.592076130693737 = (0.35200044999494384 - 10.064423664293889) / 0.35200044999494384 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_VectorOf<Single>.OnesComplementOperatorBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 10.236815077356983 > 0.3683906161658408.
IsChangePoint: Marked as a change because one of 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -239.19467824415366 (T) = (0 -10.094485749127463) / Math.Sqrt((2.1523015576101517E-07 / (30)) + (0.03152693404183285 / (19))) is less than -2.011740513728388 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (30) + (19) - 2, .025) and -27.763201104292538 = (0.3509514018459159 - 10.094485749127463) / 0.3509514018459159 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x86
OS	Windows 10.0.18362
Baseline	4ad19b10efabbbf8de5a38185bf3402661e01a5a
Compare	fbc20578253e0deb7267eea5a02b680c3cfe0e2a
Diff	Diff

Regressions in System.Numerics.Tests.Perf_VectorOf<Int16>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
OnesComplementOperatorBenchmark - Duration of single invocation	0.35 ns	10.21 ns	29.10	0.09	False
OnesComplementBenchmark - Duration of single invocation	0.35 ns	10.30 ns	29.37	0.24	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_VectorOf<Int16>*'

Related Issues

Regressions

• [Perf] Linux/x64: 15 Regressions on 11/2/2022 4:25:40 PM
• [Perf] Alpine/x64: 18 Regressions on 11/2/2022 4:25:40 PM

Improvements

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Numerics.Tests.Perf_VectorOf<Int16>.OnesComplementOperatorBenchmark

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 10.211975827169514 > 0.3683794789595173.
IsChangePoint: Marked as a change because one of 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -220.19296557199465 (T) = (0 -10.058084303266453) / Math.Sqrt((4.860989154315806E-07 / (30)) + (0.036923204677874015 / (19))) is less than -2.011740513728388 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (30) + (19) - 2, .025) and -27.636078129175147 = (0.3512381918325271 - 10.058084303266453) / 0.3512381918325271 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_VectorOf<Int16>.OnesComplementBenchmark

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 10.304935403961677 > 0.3683756099693177.
IsChangePoint: Marked as a change because one of 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -224.77841818326434 (T) = (0 -10.118272515037638) / Math.Sqrt((2.2347467100418513E-06 / (30)) + (0.03586977662209287 / (19))) is less than -2.011740513728388 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (30) + (19) - 2, .025) and -27.78532194703894 = (0.3515080544749118 - 10.118272515037638) / 0.3515080544749118 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository