[Perf] Linux/x64: 4 Improvements on 10/26/2022 10:56:11 AM

[performanceautofiler]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	a8ea8e67dc20689aa2e4c738a2f84ea3483ec872
Compare	129982ef61894433867f0ea593281fc069284ade
Diff	Diff

Improvements in System.Memory.Span<Byte>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
IndexOfAnyFiveValues - Duration of single invocation	18.91 μs	5.93 μs	0.31	0.10	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Memory.Span<Byte>*'

Related Issues

Regressions

• [Perf] Windows/x64: 14 Regressions on 10/26/2022 10:56:11 AM
• [Perf] Alpine/x64: 8 Regressions on 10/26/2022 10:56:11 AM
• [Perf] Windows/x64: 13 Regressions on 10/26/2022 10:56:11 AM
• [Perf] Linux/x64: 4 Regressions on 10/26/2022 10:56:11 AM

Improvements

• [Perf] Linux/x64: 1 Improvement on 10/26/2022 10:56:11 AM
• [Perf] Linux/arm64: 2 Improvements on 10/26/2022 10:56:11 AM
• [Perf] Windows/arm64: 2 Improvements on 10/26/2022 10:56:11 AM
• [Perf] Windows/arm64: 2 Improvements on 10/26/2022 10:56:11 AM

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Memory.Span<Byte>.IndexOfAnyFiveValues(Size: 512)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 5.931263509474754 < 17.905225940002527.
IsChangePoint: Marked as a change because one of 9/28/2022 6:40:13 PM, 10/26/2022 7:11:30 AM, 11/1/2022 6:58:35 AM falls between 10/23/2022 1:14:54 PM and 11/1/2022 6:58:35 AM.
IsImprovementStdDev: Marked as improvement because 121.92156241192414 (T) = (0 -5949.49696841963) / Math.Sqrt((4535002.815099481 / (266)) + (1972.603861633952 / (26))) is greater than 1.9681778964020553 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (266) + (26) - 2, .975) and 0.7283873578055957 = (21904.344806459085 - 5949.49696841963) / 21904.344806459085 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	a8ea8e67dc20689aa2e4c738a2f84ea3483ec872
Compare	129982ef61894433867f0ea593281fc069284ade
Diff	Diff

Improvements in System.Collections.IterateFor<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
IList - Duration of single invocation	46.98 μs	36.33 μs	0.77	0.08	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.IterateFor<Int32>*'

Related Issues

Regressions

• [Perf] Windows/x64: 14 Regressions on 10/26/2022 10:56:11 AM
• [Perf] Alpine/x64: 8 Regressions on 10/26/2022 10:56:11 AM
• [Perf] Windows/x64: 13 Regressions on 10/26/2022 10:56:11 AM
• [Perf] Linux/x64: 4 Regressions on 10/26/2022 10:56:11 AM

Improvements

• [Perf] Linux/x64: 1 Improvement on 10/26/2022 10:56:11 AM
• [Perf] Linux/arm64: 2 Improvements on 10/26/2022 10:56:11 AM
• [Perf] Windows/arm64: 2 Improvements on 10/26/2022 10:56:11 AM
• [Perf] Windows/arm64: 2 Improvements on 10/26/2022 10:56:11 AM

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Collections.IterateFor<Int32>.IList(Size: 512)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 36.33385880160551 < 40.968777294462846.
IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/23/2022 6:26:22 PM, 10/26/2022 7:11:30 AM, 11/1/2022 6:58:35 AM falls between 10/23/2022 1:14:54 PM and 11/1/2022 6:58:35 AM.
IsImprovementStdDev: Marked as improvement because 16.981626242997557 (T) = (0 -35320.62247733465) / Math.Sqrt((22936328.42075646 / (299)) + (339589.54409829236 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.12591393535382855 = (40408.632405817356 - 35320.62247733465) / 40408.632405817356 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	a8ea8e67dc20689aa2e4c738a2f84ea3483ec872
Compare	129982ef61894433867f0ea593281fc069284ade
Diff	Diff

Improvements in System.Linq.Tests.Perf_Enumerable

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
LastWithPredicate_FirstElementMatches - Duration of single invocation	199.92 ns	187.17 ns	0.94	0.10	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Linq.Tests.Perf_Enumerable*'

Related Issues

Regressions

• [Perf] Windows/x64: 14 Regressions on 10/26/2022 10:56:11 AM
• [Perf] Alpine/x64: 8 Regressions on 10/26/2022 10:56:11 AM
• [Perf] Windows/x64: 13 Regressions on 10/26/2022 10:56:11 AM
• [Perf] Linux/x64: 4 Regressions on 10/26/2022 10:56:11 AM

Improvements

• [Perf] Linux/x64: 1 Improvement on 10/26/2022 10:56:11 AM
• [Perf] Linux/arm64: 2 Improvements on 10/26/2022 10:56:11 AM
• [Perf] Windows/arm64: 2 Improvements on 10/26/2022 10:56:11 AM
• [Perf] Windows/arm64: 2 Improvements on 10/26/2022 10:56:11 AM

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Linq.Tests.Perf_Enumerable.LastWithPredicate_FirstElementMatches(input: IList)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 187.17180993534998 < 191.0733196476035.
IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/23/2022 6:26:22 PM, 10/26/2022 7:11:30 AM, 11/1/2022 6:58:35 AM falls between 10/23/2022 1:14:54 PM and 11/1/2022 6:58:35 AM.
IsImprovementStdDev: Marked as improvement because 13.106996813231413 (T) = (0 -183.99202464068244) / Math.Sqrt((109.51475931372033 / (299)) + (5.285056504731403 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.05101815931280221 = (193.8836095192781 - 183.99202464068244) / 193.8836095192781 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	a8ea8e67dc20689aa2e4c738a2f84ea3483ec872
Compare	129982ef61894433867f0ea593281fc069284ade
Diff	Diff

Improvements in System.Collections.IterateFor<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
IList - Duration of single invocation	44.69 μs	34.75 μs	0.78	0.07	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.IterateFor<String>*'

Related Issues

Regressions

• [Perf] Windows/x64: 14 Regressions on 10/26/2022 10:56:11 AM
• [Perf] Alpine/x64: 8 Regressions on 10/26/2022 10:56:11 AM
• [Perf] Windows/x64: 13 Regressions on 10/26/2022 10:56:11 AM
• [Perf] Linux/x64: 4 Regressions on 10/26/2022 10:56:11 AM

Improvements

• [Perf] Linux/x64: 1 Improvement on 10/26/2022 10:56:11 AM
• [Perf] Linux/arm64: 2 Improvements on 10/26/2022 10:56:11 AM
• [Perf] Windows/arm64: 2 Improvements on 10/26/2022 10:56:11 AM
• [Perf] Windows/arm64: 2 Improvements on 10/26/2022 10:56:11 AM

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Collections.IterateFor<String>.IList(Size: 512)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 34.74837554807079 < 40.56542647406673.
IsChangePoint: Marked as a change because one of 8/5/2022 10:47:59 PM, 9/23/2022 6:26:22 PM, 10/26/2022 7:11:30 AM, 11/1/2022 6:58:35 AM falls between 10/23/2022 1:14:54 PM and 11/1/2022 6:58:35 AM.
IsImprovementStdDev: Marked as improvement because 21.799829189562065 (T) = (0 -35143.09320811671) / Math.Sqrt((19799866.022464424 / (299)) + (189899.29812989925 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.14398276063787632 = (41054.188621603236 - 35143.09320811671) / 41054.188621603236 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[lewing]

Looks like some improvements from dotnet/runtime#76803