[Perf] Linux/x64: 4 Regressions on 10/17/2022 3:19:47 PM

[performanceautofiler]

Run Information

Architecture	x64
OS	ubuntu 18.04
Baseline	6dc9a74481888a13573d90424d06484bbf425b4a
Compare	3ba1dd21d91ddbe97dc571e45dc608610660c4f3
Diff	Diff

Regressions in System.Buffers.Text.Tests.Utf8ParserTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
TryParseUInt64 - Duration of single invocation	16.57 ns	21.71 ns	1.31	0.70	False
TryParseBool - Duration of single invocation	12.15 ns	15.53 ns	1.28	0.76	False
TryParseUInt64Hex - Duration of single invocation	19.52 ns	23.64 ns	1.21	0.72	False
TryParseUInt64 - Duration of single invocation	16.25 ns	19.19 ns	1.18	0.67	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Buffers.Text.Tests.Utf8ParserTests*'

Related Issues

Regressions

• [Perf] Windows/x64: 3 Regressions on 10/17/2022 3:19:47 PM
• [Perf] Windows/x64: 2 Regressions on 10/17/2022 3:19:47 PM
• [Perf] Windows/x86: 1 Regression on 10/17/2022 3:19:47 PM

Improvements

• [Perf] Windows/x86: 2 Improvements on 10/17/2022 3:19:47 PM

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt64(value: 12345)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 21.705713467076045 > 17.459050139547564.
IsChangePoint: Marked as a change because one of 10/17/2022 12:47:34 PM, 10/25/2022 8:17:52 AM falls between 10/16/2022 1:15:28 PM and 10/25/2022 8:17:52 AM.
IsRegressionStdDev: Marked as regression because -5.095982560024232 (T) = (0 -20.54195234805944) / Math.Sqrt((2.0526659802373763 / (14)) + (6.2184584181711555 / (29))) is less than -2.019540970439573 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (14) + (29) - 2, .025) and -0.17517474667701347 = (17.479913013911297 - 20.54195234805944) / 17.479913013911297 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseBool(value:  True )

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 15.527052682607268 > 13.408161587289829.
IsChangePoint: Marked as a change because one of 9/6/2022 5:23:23 PM, 10/18/2022 1:35:00 AM, 10/25/2022 8:17:52 AM falls between 10/16/2022 1:15:28 PM and 10/25/2022 8:17:52 AM.
IsRegressionStdDev: Marked as regression because -3.985462770358445 (T) = (0 -14.814281404048238) / Math.Sqrt((4.009433494944584 / (16)) + (4.800159812180928 / (25))) is less than -2.0226909200346674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (16) + (25) - 2, .025) and -0.21799553485926643 = (12.162837202650302 - 14.814281404048238) / 12.162837202650302 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt64Hex(value: 3039)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 23.63510769666576 > 18.165836402760476.
IsChangePoint: Marked as a change because one of 10/18/2022 8:30:48 AM, 10/25/2022 8:17:52 AM falls between 10/16/2022 1:15:28 PM and 10/25/2022 8:17:52 AM.
IsRegressionStdDev: Marked as regression because -6.17577327307506 (T) = (0 -21.65119782095658) / Math.Sqrt((1.4362623972329427 / (18)) + (6.166074661603832 / (22))) is less than -2.0243941639098457 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (18) + (22) - 2, .025) and -0.20650529871348894 = (17.945381461684015 - 21.65119782095658) / 17.945381461684015 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseUInt64(value: 0)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 19.18548689270497 > 15.439222385500502.
IsChangePoint: Marked as a change because one of 9/21/2022 2:58:31 PM, 10/17/2022 3:19:47 PM, 10/25/2022 8:17:52 AM falls between 10/16/2022 1:15:28 PM and 10/25/2022 8:17:52 AM.
IsRegressionStdDev: Marked as regression because -4.253347109705291 (T) = (0 -18.043054699283644) / Math.Sqrt((3.4239140504322267 / (14)) + (3.229176070482995 / (27))) is less than -2.0226909200346674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (14) + (27) - 2, .025) and -0.16584853410988115 = (15.47632833201563 - 18.043054699283644) / 15.47632833201563 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[radekdoulik]

Same as #9223