[Perf] Windows/x64: 3 Improvements on 7/12/2023 7:15:00 AM

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	83bf4b66ed3de5905b2e410a194a0f5f3d924c3d
Compare	82bf906968d9bc1ca5b3131c7a7af8f30d5ac2f5
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Improvements in System.Diagnostics.Perf_Process

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
StartAndWaitForExit - Duration of single invocation 📝 - Benchmark Source	9.62 ms	7.76 ms	0.81	0.14	False
Start - Duration of single invocation 📝 - Benchmark Source	2.97 ms	1.43 ms	0.48	0.30	False	1850000	3550000	1.9189189189189189)

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Diagnostics.Perf_Process*'

Payloads

Baseline
Compare

System.Diagnostics.Perf_Process.StartAndWaitForExit

ETL Files

Baseline
Compare

Histogram

Description of detection logic

IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 7.7616825 < 9.402279407051282.
IsChangePoint: Marked as a change because one of 5/6/2023 11:12:53 AM, 7/12/2023 2:12:47 AM, 7/17/2023 6:26:12 PM falls between 7/8/2023 10:33:35 PM and 7/17/2023 6:26:12 PM.
IsImprovementStdDev: Marked as improvement because 15.82905216423524 (T) = (0 -8179509.783152113) / Math.Sqrt((144892725861.92346 / (299)) + (75037486135.15579 / (8))) is greater than 1.967772354556772 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (8) - 2, .975) and 0.16121670243824515 = (9751636.455958283 - 8179509.783152113) / 9751636.455958283 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

JIT Disasms

Baseline
Compare
Diff

System.Diagnostics.Perf_Process.Start

ETL Files

Baseline
Compare

Histogram

Description of detection logic

IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 1.42645 < 2.8750388333333334.
IsChangePoint: Marked as a change because one of 5/8/2023 11:50:12 PM, 7/2/2023 6:37:07 PM, 7/3/2023 3:46:39 PM, 7/11/2023 10:26:36 PM, 7/17/2023 6:26:12 PM falls between 7/8/2023 10:33:35 PM and 7/17/2023 6:26:12 PM.
IsImprovementStdDev: Marked as improvement because 45.12279605827771 (T) = (0 -1423358.8596491227) / Math.Sqrt((111252158030.27527 / (299)) + (5872721664.006237 / (9))) is greater than 1.9677467375895035 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (9) - 2, .975) and 0.5036609986736065 = (2867715.121812721 - 1423358.8596491227) / 2867715.121812721 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

JIT Disasms

Baseline
Compare
Diff

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	Windows 10.0.18362
Queue	TigerWindows
Baseline	83bf4b66ed3de5905b2e410a194a0f5f3d924c3d
Compare	82bf906968d9bc1ca5b3131c7a7af8f30d5ac2f5
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Improvements in System.Tests.Perf_Byte

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
ToString - Duration of single invocation 📝 - Benchmark Source	3.63 ns	2.63 ns	0.72	0.07	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Byte*'

Payloads

Baseline
Compare

System.Tests.Perf_Byte.ToString(value: 255)

ETL Files

Baseline
Compare

Histogram

Description of detection logic

IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 2.628996410754918 < 3.377995592320623.
IsChangePoint: Marked as a change because one of 5/19/2023 10:30:38 AM, 6/26/2023 10:42:28 PM, 7/12/2023 2:12:47 AM, 7/17/2023 6:26:12 PM falls between 7/8/2023 10:33:35 PM and 7/17/2023 6:26:12 PM.
IsImprovementStdDev: Marked as improvement because 11.051403962999444 (T) = (0 -2.330555894672302) / Math.Sqrt((0.27246339094221894 / (299)) + (0.018410283834375738 / (8))) is greater than 1.967772354556772 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (8) - 2, .975) and 0.2118354782847959 = (2.956940880313345 - 2.330555894672302) / 2.956940880313345 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

JIT Disasms

Baseline
Compare
Diff

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository