[Perf] Linux/x64: 8 Improvements on 1/26/2023 1:49:07 PM

[performanceautofiler]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	7bc3c1d31b850723f3d658dea61432d6c8bfab99
Compare	95723eb36afac72806727ff38961fadad71ed057
Diff	Diff

Improvements in System.Numerics.Tests.Perf_VectorOf<UInt16>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
SquareRootBenchmark - Duration of single invocation	130.14 ns	111.62 ns	0.86	0.11	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf<UInt16>*'

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_VectorOf<UInt16>.SquareRootBenchmark

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 111.61647770468403 < 113.72763858651521.
IsChangePoint: Marked as a change because one of 12/17/2022 10:44:50 PM, 1/16/2023 10:36:41 AM, 1/26/2023 10:17:57 AM, 1/31/2023 8:24:06 AM falls between 1/22/2023 4:26:49 PM and 1/31/2023 8:24:06 AM.
IsImprovementStdDev: Marked as improvement because 11.354544072295289 (T) = (0 -112.32723667962368) / Math.Sqrt((66.8636301024848 / (299)) + (6.924093408238908 / (21))) is greater than 1.967451947860886 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (21) - 2, .975) and 0.06993507849686462 = (120.773543956571 - 112.32723667962368) / 120.773543956571 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	7bc3c1d31b850723f3d658dea61432d6c8bfab99
Compare	95723eb36afac72806727ff38961fadad71ed057
Diff	Diff

Improvements in System.Memory.Span<Byte>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
IndexOfAnyTwoValues - Duration of single invocation	111.66 ns	99.04 ns	0.89	0.13	False
LastIndexOfAnyValues - Duration of single invocation	1.25 μs	1.05 μs	0.84	0.14	False
LastIndexOfAnyValues - Duration of single invocation	112.77 ns	96.63 ns	0.86	0.18	False
IndexOfAnyTwoValues - Duration of single invocation	1.33 μs	1.08 μs	0.81	0.09	False
IndexOfAnyThreeValues - Duration of single invocation	49.85 ns	44.52 ns	0.89	0.34	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.Span<Byte>*'

Payloads

Baseline
Compare

Histogram

System.Memory.Span<Byte>.IndexOfAnyTwoValues(Size: 33)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 99.04105258381306 < 107.28575431928101.
IsChangePoint: Marked as a change because one of 1/26/2023 10:17:57 AM, 1/31/2023 8:24:06 AM falls between 1/22/2023 4:26:49 PM and 1/31/2023 8:24:06 AM.
IsImprovementStdDev: Marked as improvement because 22.348080748661292 (T) = (0 -98.15157636374174) / Math.Sqrt((10.596643321574831 / (257)) + (7.249958090763445 / (21))) is greater than 1.968596344330496 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (257) + (21) - 2, .975) and 0.1239955584910679 = (112.04461040708199 - 98.15157636374174) / 112.04461040708199 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.Span&lt;Byte&gt;.LastIndexOfAnyValues(Size: 512)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.051705939493853 < 1.178658186476622.
IsChangePoint: Marked as a change because one of 12/17/2022 10:44:50 PM, 12/28/2022 5:13:50 PM, 1/27/2023 11:36:27 AM, 1/31/2023 8:24:06 AM falls between 1/22/2023 4:26:49 PM and 1/31/2023 8:24:06 AM.
IsImprovementStdDev: Marked as improvement because 14.946869991929876 (T) = (0 -1066.129788613877) / Math.Sqrt((5975.280651447773 / (299)) + (1361.9179835122288 / (14))) is greater than 1.9676211333067681 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (14) - 2, .975) and 0.1318071236733621 = (1227.9872568463345 - 1066.129788613877) / 1227.9872568463345 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.Span&lt;Byte&gt;.LastIndexOfAnyValues(Size: 33)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 96.63421568763904 < 107.30201596200195.
IsChangePoint: Marked as a change because one of 1/25/2023 4:17:52 PM, 1/26/2023 10:17:57 AM, 1/31/2023 8:24:06 AM falls between 1/22/2023 4:26:49 PM and 1/31/2023 8:24:06 AM.
IsImprovementStdDev: Marked as improvement because 19.107191630031092 (T) = (0 -100.32918170315754) / Math.Sqrt((18.897006709815702 / (256)) + (8.986347228158257 / (21))) is greater than 1.9686278708474185 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (256) + (21) - 2, .975) and 0.11886413826631755 = (113.86346426276926 - 100.32918170315754) / 113.86346426276926 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.Span&lt;Byte&gt;.IndexOfAnyTwoValues(Size: 512)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.0847576339513916 < 1.2603961862079618.
IsChangePoint: Marked as a change because one of 1/26/2023 10:17:57 AM, 1/31/2023 8:24:06 AM falls between 1/22/2023 4:26:49 PM and 1/31/2023 8:24:06 AM.
IsImprovementStdDev: Marked as improvement because 13.330109743139225 (T) = (0 -1110.1759153148466) / Math.Sqrt((1067.8005352564799 / (299)) + (3987.499385938811 / (21))) is greater than 1.967451947860886 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (21) - 2, .975) and 0.1431054287752854 = (1295.5805213331323 - 1110.1759153148466) / 1295.5805213331323 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Memory.Span&lt;Byte&gt;.IndexOfAnyThreeValues(Size: 4)

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 44.51562706336844 < 46.698610112575516.
IsChangePoint: Marked as a change because one of 1/27/2023 11:36:27 AM, 1/31/2023 8:24:06 AM falls between 1/22/2023 4:26:49 PM and 1/31/2023 8:24:06 AM.
IsImprovementStdDev: Marked as improvement because 6.024122761526314 (T) = (0 -45.545413094430344) / Math.Sqrt((6.10479843370021 / (262)) + (3.3349346531310076 / (14))) is greater than 1.9686596284853233 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (262) + (14) - 2, .975) and 0.06335332675108778 = (48.6260341228231 - 45.545413094430344) / 48.6260341228231 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	7bc3c1d31b850723f3d658dea61432d6c8bfab99
Compare	95723eb36afac72806727ff38961fadad71ed057
Diff	Diff

Improvements in System.Numerics.Tests.Perf_BitOperations

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
PopCount_uint - Duration of single invocation	29.57 μs	26.67 μs	0.90	0.09	False
PopCount_ulong - Duration of single invocation	30.76 μs	26.96 μs	0.88	0.10	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_BitOperations*'

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_BitOperations.PopCount_uint

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 26.66880134310134 < 28.75060019974474.
IsChangePoint: Marked as a change because one of 11/15/2022 5:29:43 PM, 12/12/2022 5:25:39 PM, 1/5/2023 9:29:47 PM, 1/26/2023 10:17:57 AM, 1/31/2023 8:24:06 AM falls between 1/22/2023 4:26:49 PM and 1/31/2023 8:24:06 AM.
IsImprovementStdDev: Marked as improvement because 14.912085164238034 (T) = (0 -27088.942190595953) / Math.Sqrt((866101.7308845473 / (299)) + (410392.7738222146 / (21))) is greater than 1.967451947860886 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (21) - 2, .975) and 0.07617937728772188 = (29322.729461336938 - 27088.942190595953) / 29322.729461336938 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Numerics.Tests.Perf_BitOperations.PopCount_ulong

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 26.961739420855 < 29.20506300577307.
IsChangePoint: Marked as a change because one of 11/15/2022 8:48:03 PM, 12/2/2022 5:21:30 AM, 1/5/2023 9:29:47 PM, 1/27/2023 11:36:27 AM, 1/31/2023 8:24:06 AM falls between 1/22/2023 4:26:49 PM and 1/31/2023 8:24:06 AM.
IsImprovementStdDev: Marked as improvement because 16.32561484230262 (T) = (0 -27074.627320688243) / Math.Sqrt((1484683.1360777966 / (299)) + (197376.77253421376 / (14))) is greater than 1.9676211333067681 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (14) - 2, .975) and 0.07685663436251648 = (29328.735198125654 - 27074.627320688243) / 29328.735198125654 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[kotlarmilos]

looks like dotnet/runtime@a2c4d79