Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Perf] Linux/x64: 1373 Regressions on 3/2/2024 3:53:48 AM #30552

Open
performanceautofiler bot opened this issue Mar 5, 2024 · 59 comments
Open

[Perf] Linux/x64: 1373 Regressions on 3/2/2024 3:53:48 AM #30552

performanceautofiler bot opened this issue Mar 5, 2024 · 59 comments
Labels

Comments

@performanceautofiler
Copy link

performanceautofiler bot commented Mar 5, 2024

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_Int128

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
981.46 ns 1.05 μs 1.07 0.30 False
973.67 ns 1.06 μs 1.09 0.29 False
14.41 ns 21.71 ns 1.51 0.77 False
968.34 ns 1.04 μs 1.08 0.26 False
977.74 ns 1.10 μs 1.13 0.27 False
156.98 ns 172.02 ns 1.10 0.29 False
43.89 ns 58.98 ns 1.34 0.64 False
146.81 ns 158.03 ns 1.08 0.22 False

graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Int128*'

Payloads

Baseline
Compare

System.Tests.Perf_Int128.ParseSpan(value: "170141183460469231731687303715884105727")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Int128.TryParseSpan(value: "-170141183460469231731687303715884105728")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Int128.CopySign(value: 1, sign: -1)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Int128.TryParseSpan(value: "170141183460469231731687303715884105727")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Int128.TryParse(value: "170141183460469231731687303715884105727")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Int128.ParseSpan(value: "12345")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Int128.TryFormat(value: 12345)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Int128.TryParse(value: "12345")

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.Perf_LengthBucketsFrozenDictionary

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
26.69 μs 29.32 μs 1.10 0.21 False
176.08 ns 210.99 ns 1.20 0.50 False
218.53 μs 245.26 μs 1.12 0.44 False
582.97 μs 671.68 μs 1.15 0.32 False
350.43 μs 437.77 μs 1.25 0.41 False
3.21 μs 3.46 μs 1.08 0.50 False
16.81 μs 19.65 μs 1.17 0.47 False
31.99 μs 36.50 μs 1.14 0.49 False
17.44 μs 21.59 μs 1.24 0.47 False
1.70 μs 2.14 μs 1.25 0.49 False
182.48 ns 226.43 ns 1.24 0.42 False
552.74 ns 589.18 ns 1.07 0.35 False
301.74 ns 376.89 ns 1.25 0.42 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Perf_LengthBucketsFrozenDictionary*'

Payloads

Baseline
Compare

System.Collections.Perf_LengthBucketsFrozenDictionary.ToFrozenDictionary(Count: 1000, ItemsPerBucket: 5)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_LengthBucketsFrozenDictionary.TryGetValue_False_FrozenDictionary(Count: 10, ItemsPerBucket: 5)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_LengthBucketsFrozenDictionary.TryGetValue_False_FrozenDictionary(Count: 10000, ItemsPerBucket: 1)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_LengthBucketsFrozenDictionary.TryGetValue_True_FrozenDictionary(Count: 10000, ItemsPerBucket: 5)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_LengthBucketsFrozenDictionary.TryGetValue_True_FrozenDictionary(Count: 10000, ItemsPerBucket: 1)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_LengthBucketsFrozenDictionary.TryGetValue_True_FrozenDictionary(Count: 100, ItemsPerBucket: 1)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_LengthBucketsFrozenDictionary.TryGetValue_False_FrozenDictionary(Count: 1000, ItemsPerBucket: 5)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_LengthBucketsFrozenDictionary.TryGetValue_True_FrozenDictionary(Count: 1000, ItemsPerBucket: 1)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_LengthBucketsFrozenDictionary.TryGetValue_False_FrozenDictionary(Count: 1000, ItemsPerBucket: 1)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_LengthBucketsFrozenDictionary.TryGetValue_False_FrozenDictionary(Count: 100, ItemsPerBucket: 5)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_LengthBucketsFrozenDictionary.TryGetValue_False_FrozenDictionary(Count: 10, ItemsPerBucket: 1)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_LengthBucketsFrozenDictionary.TryGetValue_True_FrozenDictionary(Count: 10, ItemsPerBucket: 5)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_LengthBucketsFrozenDictionary.TryGetValue_True_FrozenDictionary(Count: 10, ItemsPerBucket: 1)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@performanceautofiler performanceautofiler bot added arch-wasm arch-x64 branch-refs/heads/main kind-micro os-linux perf-regression PGO Applied if there were any profile guided optimization updates in the observed interval. untriaged wasm-aot labels Mar 5, 2024
Copy link
Author

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Linq.Tests.Perf_Enumerable

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
3.28 μs 5.00 μs 1.52 0.53 False
5.28 μs 5.97 μs 1.13 0.41 False
3.58 μs 5.01 μs 1.40 0.48 False
13.55 μs 16.30 μs 1.20 0.31 False
3.35 μs 4.70 μs 1.40 0.53 False
7.85 μs 9.75 μs 1.24 0.40 False
4.28 μs 5.49 μs 1.28 0.56 False
15.15 μs 17.75 μs 1.17 0.37 False
3.47 μs 4.44 μs 1.28 0.50 False
39.54 μs 43.04 μs 1.09 0.21 False
23.48 μs 26.51 μs 1.13 0.27 False
26.04 μs 28.64 μs 1.10 0.22 False
3.33 μs 4.84 μs 1.46 0.59 False
3.64 μs 4.79 μs 1.32 0.55 False
20.87 μs 23.97 μs 1.15 0.19 False
3.39 μs 4.99 μs 1.47 0.52 False
2.60 μs 4.12 μs 1.59 0.53 False
15.46 μs 18.14 μs 1.17 0.37 False
41.74 μs 47.29 μs 1.13 0.19 False
245.23 ns 262.96 ns 1.07 0.20 False
4.18 μs 4.90 μs 1.17 0.53 False
25.21 μs 27.51 μs 1.09 0.18 False
18.80 μs 23.13 μs 1.23 0.28 False
4.13 μs 5.67 μs 1.37 0.40 False
25.58 μs 28.34 μs 1.11 0.16 False
3.61 μs 4.71 μs 1.31 0.48 False
9.94 μs 11.91 μs 1.20 0.34 False
3.88 μs 5.08 μs 1.31 0.53 False
14.46 μs 17.82 μs 1.23 0.31 False
8.05 μs 10.13 μs 1.26 0.41 False
5.16 μs 5.80 μs 1.12 0.39 False
7.71 μs 9.34 μs 1.21 0.38 False
43.86 μs 55.16 μs 1.26 0.25 False
3.40 μs 4.91 μs 1.44 0.51 False
3.24 μs 4.49 μs 1.39 0.55 False
21.10 μs 23.50 μs 1.11 0.25 False
34.01 ns 41.19 ns 1.21 0.72 False
29.64 μs 32.51 μs 1.10 0.27 False
5.11 μs 5.49 μs 1.07 0.49 False
22.21 μs 25.73 μs 1.16 0.21 False
13.84 μs 17.73 μs 1.28 0.48 False
3.51 μs 4.55 μs 1.30 0.51 False
621.07 ns 792.64 ns 1.28 0.42 False
3.35 μs 5.67 μs 1.69 0.51 False
4.31 μs 5.38 μs 1.25 0.49 False
6.02 μs 7.30 μs 1.21 0.45 False

Copy link
Author

aNMQNoKP9VLFMVHaZZcivsGayOb9WdtM4zWFaC3im7m+PFknxtvI8C5qbarxy6Ze9kVcVWxd6zwoxwcF/fT/tFBr3+Qnsx7vUG/P+iddI9PT0/To7ev03SQpiGFdUpxFPfAOK4Wiq/jJmCooMNeJWxZ72Xo7JzWCTP63YEDH6dC89u79Al5BtZJytBXXcQPbrLBh7fejSsf6SjpsCZUCJxdoABdyHqHhGY1m1Ay+jNAFu6YlxyJ3XkXs9j65oHNdpoOW+dGOqWz/ZrqDW6zTRGeSIIkZNEH3zr/ttTbbZCwWNskYLaSgjK+Bpv8A6JH9S79BAAA>) | 3.61 μs | 4.90 μs | 1.36 | 0.47 | False | | |
|

| 25.96 μs | 30.20 μs | 1.16 | 0.26 | False | | |
| | 3.81 μs | 5.71 μs | 1.50 | 0.50 | False | | |
| | 18.36 μs | 23.62 μs | 1.29 | 0.30 | False | | |
| | 7.73 μs | 9.57 μs | 1.24 | 0.41 | False | | |
| | 29.39 μs | 33.56 μs | 1.14 | 0.17 | False | | |
| | 29.32 μs | 32.32 μs | 1.10 | 0.21 | False | | |
| | 2.95 μs | 4.20 μs | 1.42 | 0.50 | False | | |
| | 8.84 μs | 10.96 μs | 1.24 | 0.35 | False | | |
| | 77.17 μs | 102.27 μs | 1.33 | 0.48 | False | | |
| | 2.22 μs | 2.95 μs | 1.32 | 0.45 | False | | |
| | 7.83 μs | 10.09 μs | 1.29 | 0.34 | False | | |
| | 3.19 μs | 4.62 μs | 1.45 | 0.53 | False | | |
| | 2.54 μs | 3.56 μs | 1.40 | 0.51 | False | | |
| | 20.88 μs | 24.28 μs | 1.16 | 0.22 | False | | |
| | 74.17 ns | 92.88 ns | 1.25 | 0.55 | False | | |
| | 40.33 μs | 47.82 μs | 1.19 | 0.23 | False | | |
| | 1.15 μs | 1.36 μs | 1.18 | 0.42 | False | | |
| | 18.60 μs | 22.49 μs | 1.21 | 0.27 | False | | |
| | 19.59 μs | 24.36 μs | 1.24 | 0.33 | False | | |
| | 36.87 ns | 81.70 ns | 2.22 | 0.62 | True | | |
| | 3.26 μs | 4.74 μs | 1.46 | 0.51 | False | | |

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Linq.Tests.Perf_Enumerable*'

Payloads

Baseline
Compare

System.Linq.Tests.Perf_Enumerable.SingleWithPredicate_LastElementMatches(input: IEnumerable)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.WhereSingleOrDefault_LastElementMatches(input: Array)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.SingleWithPredicate_FirstElementMatches(input: IEnumerable)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.SelectToArray(input: Array)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.LastWithPredicate_FirstElementMatches(input: IEnumerable)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.WhereLast_LastElementMatches(input: List)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.ToDictionary(input: Array)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.Where(input: Array)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.Aggregate_Seed(input: IEnumerable)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.Prepend(input: IEnumerable)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.WhereSelect(input: List)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.Select(input: IList)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.AnyWithPredicate_LastElementMatches(input: IEnumerable)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.Contains_ElementNotFound(input: IEnumerable)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.TakeLastHalf(input: List)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.All_AllElementsMatch(input: IEnumerable)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.Max(input: IEnumerable)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.Select(input: Array)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.Intersect(input: IEnumerable)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.ToList(input: ICollection)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.SingleWithPredicate_FirstElementMatches(input: List)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.SelectToList(input: Range)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.Where(input: List)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.ToList(input: IEnumerable)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.SelectToList(input: IList)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.Range

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.ToDictionary(input: IEnumerable)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.AnyWithPredicate_LastElementMatches(input: List)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.SelectToList(input: Array)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.WhereSingleOrDefault_LastElementMatches(input: List)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.WhereAny_LastElementMatches(input: Array)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.WhereFirst_LastElementMatches(input: List)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.Append(input: IEnumerable)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.Aggregate(input: IEnumerable)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.AnyWithPredicate_LastElementMatches(input: Array)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.SkipHalfTakeHalf(input: IEnumerable)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.Count(input: ICollection)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.TakeLastHalf(input: IEnumerable)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.WhereSingle_LastElementMatches(input: Array)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.Except(input: IEnumerable)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.Concat_Once(input: IEnumerable)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.SingleWithPredicate_LastElementMatches(input: Array)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.ElementAt(input: IEnumerable)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.SingleWithPredicate_FirstElementMatches(input: Array)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.Repeat

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.SequenceEqual(input1: IEnumerable, input2: IEnumerable)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.FirstWithPredicate_LastElementMatches(input: List)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.Take_All(input: IEnumerable)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.SingleWithPredicate_LastElementMatches(input: List)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.Select(input: List)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.WhereSingle_LastElementMatches(input: List)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.Distinct(input: IEnumerable)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.WhereSelect(input: IEnumerable)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.Sum(input: IEnumerable)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.CastToBaseClass(input: IEnumerable)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.Concat_TenTimes(input: IEnumerable)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.Average(input: IEnumerable)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.WhereAny_LastElementMatches(input: List)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.FirstWithPredicate_LastElementMatches(input: Array)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.Min(input: IEnumerable)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.LastWithPredicate_FirstElementMatches(input: IOrderedEnumerable)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.SequenceEqual(input1: Array, input2: Array)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.AppendPrepend(input: IEnumerable)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.Count(input: IEnumerable)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.SelectToList(input: List)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.WhereSelect(input: Array)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.ElementAt(input: IList)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_Enumerable.FirstWithPredicate_LastElementMatches(input: IEnumerable)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.CtorFromCollectionNonGeneric<String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
63.77 μs 72.80 μs 1.14 0.39 False
663.38 μs 748.08 μs 1.13 0.20 False
74.41 μs 84.85 μs 1.14 0.31 False
65.75 μs 73.11 μs 1.11 0.38 False

graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CtorFromCollectionNonGeneric&lt;String&gt;*'

Payloads

Baseline
Compare

System.Collections.CtorFromCollectionNonGeneric<String>.Stack(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.CtorFromCollectionNonGeneric<String>.SortedList(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.CtorFromCollectionNonGeneric<String>.Hashtable(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.CtorFromCollectionNonGeneric<String>.Queue(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Copy link
Author

performanceautofiler bot commented Mar 5, 2024

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Memory.Span<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
52.14 ns 63.53 ns 1.22 0.23 False
35.00 ns 42.49 ns 1.21 0.45 False
58.91 ns 68.10 ns 1.16 0.54 False
22.16 ns 26.70 ns 1.21 0.78 False
3.01 ns 4.17 ns 1.38 0.43 False
20.92 ns 31.08 ns 1.49 0.78 False
15.37 ns 22.14 ns 1.44 0.78 False
8.05 ns 18.13 ns 2.25 0.81 False
76.41 ns 82.86 ns 1.08 0.41 False
17.29 ns 25.46 ns 1.47 0.72 False
14.12 ns 16.63 ns 1.18 0.74 False
12.38 ns 17.02 ns 1.37 0.73 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.Span&lt;Int32&gt;*'

Payloads

Baseline
Compare

System.Memory.Span<Int32>.SequenceCompareTo(Size: 33)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Int32>.ToArray(Size: 33)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Int32>.LastIndexOfValue(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Int32>.Fill(Size: 33)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Int32>.GetPinnableReference(Size: 33)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Int32>.Reverse(Size: 33)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Int32>.Reverse(Size: 4)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Int32>.Clear(Size: 4)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Int32>.Clear(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Int32>.LastIndexOfValue(Size: 33)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Int32>.IndexOfAnyFourValues(Size: 4)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Int32>.BinarySearch(Size: 4)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_Version

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
159.32 ns 174.25 ns 1.09 0.30 False
119.95 ns 132.27 ns 1.10 0.41 False
241.93 ns 273.14 ns 1.13 0.31 False
23.23 ns 38.86 ns 1.67 0.69 False
32.22 ns 40.56 ns 1.26 0.67 False
143.59 ns 167.95 ns 1.17 0.36 False
191.62 ns 225.05 ns 1.17 0.39 False

graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Version*'

Payloads

Baseline
Compare

System.Tests.Perf_Version.TryParse3

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Version.TryParse2

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Version.Parse4

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Version.Ctor2

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Version.Ctor3

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Version.Parse2

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Version.Parse3

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_Uri

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
541.86 ns 628.66 ns 1.16 0.21 False
13.30 μs 16.75 μs 1.26 0.07 False
521.97 ns 556.20 ns 1.07 0.19 False
32.37 μs 38.68 μs 1.19 0.03 False
333.91 ns 355.04 ns 1.06 0.07 False

graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Uri*'

Payloads

Baseline
Compare

System.Tests.Perf_Uri.BuilderToString

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Uri.EscapeDataString(input: "{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Uri.UriBuilderReplacePort

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Uri.EscapeDataString(input: "üüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüüü")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Uri.Ctor(input: "http://xn--hst-sna.with.xn--nicode-2ya")

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Copy link
Author

performanceautofiler bot commented Mar 5, 2024

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Serialization.Tests.WriteJson<ImmutableDictionary<String, String>>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
104.45 μs 117.42 μs 1.12 0.19 False
116.47 μs 139.89 μs 1.20 0.16 False
120.87 μs 141.15 μs 1.17 0.16 False
122.31 μs 140.95 μs 1.15 0.16 False
100.99 μs 117.64 μs 1.16 0.19 False
129.88 μs 146.52 μs 1.13 0.14 False
107.24 μs 116.82 μs 1.09 0.17 False

graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson&lt;ImmutableDictionary&lt;String, String&gt;&gt;*'

Payloads

Baseline
Compare

System.Text.Json.Serialization.Tests.WriteJson<ImmutableDictionary<String, String>>.SerializeToString(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.WriteJson<ImmutableDictionary<String, String>>.SerializeToWriter(Mode: Reflection)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.WriteJson<ImmutableDictionary<String, String>>.SerializeToString(Mode: Reflection)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.WriteJson<ImmutableDictionary<String, String>>.SerializeToUtf8Bytes(Mode: Reflection)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.WriteJson<ImmutableDictionary<String, String>>.SerializeToUtf8Bytes(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.WriteJson<ImmutableDictionary<String, String>>.SerializeObjectProperty(Mode: Reflection)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.WriteJson<ImmutableDictionary<String, String>>.SerializeObjectProperty(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 512bcaf1b198a7234fad4d1791c558f698b1eb15
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.Perf_SingleCharFrozenDictionary

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
28.80 μs 36.60 μs 1.27 0.50 False
444.52 ns 555.01 ns 1.25 0.52 False
307.17 ns 386.24 ns 1.26 0.55 False
327.85 μs 400.97 μs 1.22 0.49 False
43.88 μs 52.11 μs 1.19 0.49 False
3.33 μs 3.83 μs 1.15 0.56 False
1.40 ms 1.58 ms 1.12 0.23 False
145.91 μs 164.40 μs 1.13 0.26 False
4.17 μs 5.10 μs 1.22 0.51 False
420.68 μs 539.67 μs 1.28 0.50 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Perf_SingleCharFrozenDictionary*'

Payloads

Baseline
Compare

System.Collections.Perf_SingleCharFrozenDictionary.TryGetValue_False_FrozenDictionary(Count: 1000)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_SingleCharFrozenDictionary.TryGetValue_True_FrozenDictionary(Count: 10)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_SingleCharFrozenDictionary.TryGetValue_False_FrozenDictionary(Count: 10)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_SingleCharFrozenDictionary.TryGetValue_False_FrozenDictionary(Count: 10000)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_SingleCharFrozenDictionary.TryGetValue_True_FrozenDictionary(Count: 1000)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_SingleCharFrozenDictionary.TryGetValue_False_FrozenDictionary(Count: 100)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_SingleCharFrozenDictionary.ToFrozenDictionary(Count: 10000)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_SingleCharFrozenDictionary.ToFrozenDictionary(Count: 1000)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_SingleCharFrozenDictionary.TryGetValue_True_FrozenDictionary(Count: 100)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_SingleCharFrozenDictionary.TryGetValue_True_FrozenDictionary(Count: 10000)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Xml.Linq.Perf_XElement

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
341.12 ns 383.96 ns 1.13 0.23 False
403.38 ns 462.87 ns 1.15 0.20 False
168.17 ns 196.87 ns 1.17 0.37 False
186.01 ns 221.24 ns 1.19 0.39 False
243.85 ns 341.22 ns 1.40 0.44 False
199.74 ns 237.37 ns 1.19 0.30 False

graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Xml.Linq.Perf_XElement*'

Payloads

Baseline
Compare

System.Xml.Linq.Perf_XElement.CreateElementWithNamespace

ETL Files

Histogram

JIT Disasms

System.Xml.Linq.Perf_XElement.CreateElementsWithNamespace

ETL Files

Histogram

JIT Disasms

System.Xml.Linq.Perf_XElement.GetAttribute

ETL Files

Histogram

JIT Disasms

System.Xml.Linq.Perf_XElement.GetElement

ETL Files

Histogram

JIT Disasms

System.Xml.Linq.Perf_XElement.GetValue

ETL Files

Histogram

JIT Disasms

System.Xml.Linq.Perf_XElement.CreateElement

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Copy link
Author

performanceautofiler bot commented Mar 5, 2024

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_Char

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
78.70 ns 99.04 ns 1.26 0.43 False
35.48 ns 53.31 ns 1.50 0.55 False
141.10 ns 162.86 ns 1.15 0.34 False
73.98 ns 81.92 ns 1.11 0.37 False
86.38 ns 94.18 ns 1.09 0.49 False
76.82 ns 99.82 ns 1.30 0.42 False
77.47 ns 101.14 ns 1.31 0.42 False
139.36 ns 167.71 ns 1.20 0.37 False
37.16 ns 47.58 ns 1.28 0.53 False
74.47 ns 85.54 ns 1.15 0.37 False
39.38 ns 47.18 ns 1.20 0.51 False
35.52 ns 48.48 ns 1.36 0.56 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Char*'

Payloads

Baseline
Compare

System.Tests.Perf_Char.Char_ToUpper(c: '你', cultureName: zh-Hans)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Char.Char_ToUpper(c: 'a', cultureName: en-US)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Char.Char_IsLower(input: "Good afternoon, Constable!")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Char.Char_ToLowerInvariant(input: "Hello World!")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Char.Char_ToLower(c: 'İ', cultureName: en-US)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Char.Char_ToLower(c: '你', cultureName: zh-Hans)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Char.Char_ToUpper(c: 'İ', cultureName: en-US)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Char.Char_IsUpper(input: "Good afternoon, Constable!")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Char.Char_ToLower(c: 'A', cultureName: en-US)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Char.Char_ToUpperInvariant(input: "Hello World!")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Char.Char_ToLower(c: 'a', cultureName: en-US)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Char.Char_ToUpper(c: 'A', cultureName: en-US)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_Enum

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
706.89 ns 753.06 ns 1.07 0.19 False
100.23 ns 113.25 ns 1.13 0.44 False
64.06 ns 72.49 ns 1.13 0.59 False
137.47 ns 150.54 ns 1.10 0.32 False
181.02 ns 195.59 ns 1.08 0.34 False
105.04 ns 116.84 ns 1.11 0.51 False
129.79 ns 147.63 ns 1.14 0.50 False
106.25 ns 134.19 ns 1.26 0.42 False
70.13 ns 85.11 ns 1.21 0.54 False
67.28 ns 84.19 ns 1.25 0.58 False
56.36 ns 65.45 ns 1.16 0.51 False
633.42 ns 687.38 ns 1.09 0.17 False
61.96 ns 69.82 ns 1.13 0.58 False
16.92 ns 19.90 ns 1.18 0.75 False
132.96 ns 157.71 ns 1.19 0.43 False
118.85 ns 135.41 ns 1.14 0.44 False
117.09 ns 132.94 ns 1.14 0.32 False
144.12 ns 167.78 ns 1.16 0.43 False
132.22 ns 152.07 ns 1.15 0.47 False
1.32 μs 1.49 μs 1.14 0.20 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Enum*'

Payloads

Baseline
Compare

System.Tests.Perf_Enum.StringFormat(value: Red, Green)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Enum.GetValuesAsUnderlyingType_Generic

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Enum.ToString_Flags(value: Yellow)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Enum.ToString_Flags(value: 32)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Enum.GetName_NonGeneric_Flags

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Enum.ToString_Format_NonFlags(value: 8, format: "F")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Enum.GetName_Generic_Flags

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Enum.GetValuesAsUnderlyingType_NonGeneric

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Enum.ToString_Format_Flags_Large(value: All, format: "")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Enum.ToString_Format_Flags_Large(value: All, format: "g")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Enum.ToString_Format_NonFlags(value: Saturday, format: "D")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Enum.StringFormat(value: Red)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Enum.ToString_Format_NonFlags(value: Sunday, format: "")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Enum.Compare

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Enum.IsDefined_Generic_Flags

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Enum.GetName_Generic_NonFlags

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Enum.ToString_NonFlags_Large(value: 42)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Enum.ToString_Format_NonFlags(value: Friday, format: "X")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Enum.IsDefined_Generic_NonFlags

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Enum.InterpolateIntoStringBuilder_Flags(value: 32)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Copy link
Author

performanceautofiler bot commented Mar 5, 2024

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_Int64

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
71.25 ns 80.86 ns 1.13 0.42 False
60.99 ns 74.02 ns 1.21 0.51 False
62.15 ns 69.06 ns 1.11 0.44 False
58.29 ns 72.12 ns 1.24 0.46 False
60.89 ns 65.41 ns 1.07 0.42 False
41.67 ns 55.37 ns 1.33 0.60 False
67.65 ns 82.89 ns 1.23 0.55 False

graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Int64*'

Payloads

Baseline
Compare

System.Tests.Perf_Int64.TryFormat(value: -9223372036854775808)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Int64.ParseSpan(value: "9223372036854775807")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Int64.TryParseSpan(value: "-9223372036854775808")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Int64.TryParse(value: "9223372036854775807")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Int64.TryParseSpan(value: "9223372036854775807")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Int64.TryParse(value: "12345")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Int64.Parse(value: "-9223372036854775808")

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Buffers.Tests.ReadOnlySequenceTests<Byte>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
20.65 ns 25.24 ns 1.22 0.51 False
496.31 ns 594.36 ns 1.20 0.49 False
73.10 ns 97.49 ns 1.33 0.52 False
118.94 ns 151.03 ns 1.27 0.48 False
21.95 ns 25.52 ns 1.16 0.62 False
427.22 ns 489.61 ns 1.15 0.49 False
23.24 ns 27.79 ns 1.20 0.65 False
32.57 ns 41.75 ns 1.28 0.60 False
38.40 ns 47.53 ns 1.24 0.55 False
79.58 ns 89.75 ns 1.13 0.56 False
396.03 ns 476.69 ns 1.20 0.56 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Tests.ReadOnlySequenceTests&lt;Byte&gt;*'

Payloads

Baseline
Compare

System.Buffers.Tests.ReadOnlySequenceTests<Byte>.FirstSpanTenSegments

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.ReadOnlySequenceTests<Byte>.IterateGetPositionMemory

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.ReadOnlySequenceTests<Byte>.SliceSingleSegment

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.ReadOnlySequenceTests<Byte>.SliceTenSegments

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.ReadOnlySequenceTests<Byte>.FirstSpanSingleSegment

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.ReadOnlySequenceTests<Byte>.IterateGetPositionArray

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.ReadOnlySequenceTests<Byte>.FirstTenSegments

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.ReadOnlySequenceTests<Byte>.FirstSpanArray

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.ReadOnlySequenceTests<Byte>.FirstSpanMemory

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.ReadOnlySequenceTests<Byte>.SliceArray

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.ReadOnlySequenceTests<Byte>.IterateTryGetTenSegments

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Tests.Perf_Depth

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
218.24 ns 251.40 ns 1.15 0.40 False
46.10 μs 54.35 μs 1.18 0.48 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Tests.Perf_Depth*'

Payloads

Baseline
Compare

System.Text.Json.Tests.Perf_Depth.ReadSpanEmptyLoop(Depth: 1)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Tests.Perf_Depth.ReadSpanEmptyLoop(Depth: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Copy link
Author

performanceautofiler bot commented Mar 5, 2024

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Memory.Span<Char>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
20.38 ns 27.58 ns 1.35 0.77 False
16.86 ns 23.12 ns 1.37 0.69 False
16.43 ns 27.15 ns 1.65 0.75 False
46.63 ns 56.95 ns 1.22 0.44 False
9.31 ns 12.75 ns 1.37 0.74 False
38.92 ns 44.20 ns 1.14 0.68 False
11.73 ns 17.67 ns 1.51 0.74 False
6.75 ns 14.48 ns 2.15 0.81 False
9.74 ns 14.31 ns 1.47 0.75 False
10.23 ns 13.91 ns 1.36 0.77 False
47.64 ns 57.23 ns 1.20 0.47 False
9.77 ns 12.84 ns 1.32 0.70 False
13.32 ns 16.82 ns 1.26 0.78 False
15.96 ns 29.18 ns 1.83 0.80 False
45.56 ns 54.00 ns 1.19 0.37 False
8.28 ns 14.21 ns 1.72 0.73 False
27.35 ns 36.67 ns 1.34 0.55 False
11.63 ns 15.41 ns 1.33 0.73 False
66.39 ns 78.77 ns 1.19 0.41 False
16.87 ns 24.17 ns 1.43 0.77 False
53.71 ns 69.51 ns 1.29 0.44 False
52.10 ns 59.25 ns 1.14 0.47 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.Span&lt;Char&gt;*'

Payloads

Baseline
Compare

System.Memory.Span<Char>.Fill(Size: 33)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Char>.IndexOfAnyFiveValues(Size: 33)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Char>.Reverse(Size: 33)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Char>.IndexOfAnyFourValues(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Char>.StartsWith(Size: 4)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Char>.LastIndexOfValue(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Char>.IndexOfAnyThreeValues(Size: 33)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Char>.Clear(Size: 4)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Char>.EndsWith(Size: 4)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Char>.LastIndexOfValue(Size: 4)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Char>.IndexOfAnyTwoValues(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Char>.IndexOfAnyThreeValues(Size: 4)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Char>.IndexOfAnyFourValues(Size: 4)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Char>.Reverse(Size: 4)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Char>.LastIndexOfAnyValues(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Char>.SequenceEqual(Size: 4)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Char>.ToArray(Size: 33)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Char>.StartsWith(Size: 33)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Char>.Reverse(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Char>.IndexOfAnyFourValues(Size: 33)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Char>.IndexOfAnyFiveValues(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Char>.IndexOfAnyThreeValues(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Serialization.Tests.ReadJson<ClassRecord>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
3.26 μs 3.66 μs 1.12 0.16 False
4.05 μs 4.47 μs 1.10 0.18 False
2.67 μs 3.03 μs 1.13 0.17 False
3.95 μs 4.35 μs 1.10 0.16 False
2.75 μs 3.19 μs 1.16 0.15 False

graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.ReadJson&lt;ClassRecord&gt;*'

Payloads

Baseline
Compare

System.Text.Json.Serialization.Tests.ReadJson<ClassRecord>.DeserializeFromString(Mode: Reflection)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.ReadJson<ClassRecord>.DeserializeFromReader(Mode: Reflection)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.ReadJson<ClassRecord>.DeserializeFromUtf8Bytes(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.ReadJson<ClassRecord>.DeserializeFromReader(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.ReadJson<ClassRecord>.DeserializeFromUtf8Bytes(Mode: Reflection)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Copy link
Author

performanceautofiler bot commented Mar 5, 2024

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.IterateForEach<String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
27.40 μs 29.78 μs 1.09 0.30 False
118.43 μs 137.18 μs 1.16 0.36 False
24.64 μs 27.09 μs 1.10 0.52 False
342.60 μs 414.20 μs 1.21 0.25 False
111.64 μs 133.12 μs 1.19 0.34 False
6.99 μs 8.21 μs 1.17 0.34 False
10.85 μs 15.07 μs 1.39 0.39 False
240.00 μs 252.55 μs 1.05 0.23 False
8.43 μs 9.89 μs 1.17 0.30 False
127.31 μs 156.67 μs 1.23 0.36 False
9.21 μs 9.77 μs 1.06 0.36 False
7.97 μs 9.71 μs 1.22 0.40 False
20.31 μs 25.24 μs 1.24 0.35 False
24.35 μs 29.94 μs 1.23 0.40 False
16.79 μs 21.38 μs 1.27 0.42 False
20.67 μs 24.90 μs 1.20 0.42 False
359.90 μs 421.30 μs 1.17 0.26 False
13.20 μs 15.65 μs 1.19 0.37 False
17.19 μs 20.19 μs 1.17 0.31 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.IterateForEach&lt;String&gt;*'

Payloads

Baseline
Compare

System.Collections.IterateForEach<String>.SortedSet(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.IterateForEach<String>.ImmutableSortedSet(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.IterateForEach<String>.SortedList(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.IterateForEach<String>.ImmutableHashSet(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.IterateForEach<String>.ImmutableList(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.IterateForEach<String>.FrozenSet(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.IterateForEach<String>.IEnumerable(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.IterateForEach<String>.SortedDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.IterateForEach<String>.HashSet(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.IterateForEach<String>.ImmutableSortedDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.IterateForEach<String>.List(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.IterateForEach<String>.Stack(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.IterateForEach<String>.ImmutableStack(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.IterateForEach<String>.ConcurrentDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.IterateForEach<String>.ConcurrentQueue(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.IterateForEach<String>.ImmutableQueue(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.IterateForEach<String>.ImmutableDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.IterateForEach<String>.FrozenDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.IterateForEach<String>.ConcurrentBag(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Memory.ReadOnlySpan

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
19.23 ns 23.85 ns 1.24 0.58 False
30.53 ns 40.77 ns 1.34 0.57 False
55.95 ns 69.15 ns 1.24 0.43 False
68.62 ns 75.02 ns 1.09 0.31 False
35.61 ns 40.02 ns 1.12 0.22 False
70.01 ns 84.08 ns 1.20 0.39 False

graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.ReadOnlySpan*'

Payloads

Baseline
Compare

System.Memory.ReadOnlySpan.IndexOfString(input: "Hello Worldbbbbbbbbbbbbbbcbbbbbbbbbbbbbbbbbbba!", value: "y", comparisonType: Ordinal)

ETL Files

Histogram

JIT Disasms

System.Memory.ReadOnlySpan.Trim(input: " abcdefg ")

ETL Files

Histogram

JIT Disasms

System.Memory.ReadOnlySpan.IndexOfString(input: "ABCDE", value: "c", comparisonType: InvariantCultureIgnoreCase)

ETL Files

Histogram

JIT Disasms

System.Memory.ReadOnlySpan.IndexOfString(input: "AAAAA5AAAA", value: "5", comparisonType: InvariantCulture)

ETL Files

Histogram

JIT Disasms

System.Memory.ReadOnlySpan.IndexOfString(input: "AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAXAAAAAAAAAAAAAAAAAAAAAAAAAAAAA", value: "x", comparisonType: OrdinalIgnoreCase)

ETL Files

Histogram

JIT Disasms

System.Memory.ReadOnlySpan.IndexOfString(input: "string1", value: "string2", comparisonType: InvariantCulture)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Copy link
Author

performanceautofiler bot commented Mar 5, 2024

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.CreateAddAndClear<String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
36.47 μs 42.43 μs 1.16 0.41 False
2.60 ms 2.96 ms 1.14 0.12 False
50.56 μs 55.02 μs 1.09 0.21 False
53.38 μs 64.06 μs 1.20 0.21 False
9.24 μs 11.18 μs 1.21 0.49 False
2.42 ms 2.86 ms 1.18 0.12 False
14.27 μs 16.80 μs 1.18 0.36 False
1.02 ms 1.13 ms 1.11 0.20 False
41.91 μs 46.56 μs 1.11 0.21 False
10.57 μs 11.87 μs 1.12 0.29 False
682.82 μs 771.12 μs 1.13 0.27 False
11.42 μs 13.41 μs 1.17 0.46 False
1.21 ms 1.41 ms 1.16 0.17 False
698.18 μs 805.82 μs 1.15 0.15 False
13.20 μs 17.21 μs 1.30 0.57 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CreateAddAndClear&lt;String&gt;*'

Payloads

Baseline
Compare

System.Collections.CreateAddAndClear<String>.ConcurrentBag(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.CreateAddAndClear<String>.ImmutableDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.CreateAddAndClear<String>.Dictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.CreateAddAndClear<String>.IDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.CreateAddAndClear<String>.List(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.CreateAddAndClear<String>.ImmutableHashSet(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.CreateAddAndClear<String>.LinkedList(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.CreateAddAndClear<String>.ImmutableSortedDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.CreateAddAndClear<String>.HashSet(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.CreateAddAndClear<String>.ConcurrentQueue(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.CreateAddAndClear<String>.SortedSet(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.CreateAddAndClear<String>.Queue(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.CreateAddAndClear<String>.SortedDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.CreateAddAndClear<String>.SortedList(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.CreateAddAndClear<String>.ICollection(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_String

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
220.38 ns 261.24 ns 1.19 0.27 False
59.49 ns 75.76 ns 1.27 0.54 False
81.45 ns 96.87 ns 1.19 0.43 False
1.23 μs 1.37 μs 1.12 0.16 False
16.28 ns 19.05 ns 1.17 0.64 False
2.39 μs 2.65 μs 1.11 0.07 False
15.31 ns 23.46 ns 1.53 0.68 False
136.44 ns 171.41 ns 1.26 0.29 False
78.46 ns 83.00 ns 1.06 0.43 False
139.42 ns 151.96 ns 1.09 0.29 False
25.79 ns 33.92 ns 1.32 0.75 False
12.95 ns 14.90 ns 1.15 0.76 False
263.93 ns 302.60 ns 1.15 0.24 False
137.18 ns 154.19 ns 1.12 0.29 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_String*'

Payloads

Baseline
Compare

System.Tests.Perf_String.ToLowerInvariant(s: "This is a much longer piece of text that might benefit more from vectorization.")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_String.ToLower(s: "test")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_String.Remove_IntInt(s: "dzsdzsDDZSDZSDZSddsz", i1: 0, i2: 8)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_String.Format_OneArg(s: "Testing {0}, {0:C}, {0:D5}, {0:E} - {0:F4}{0:G}{0:N} {0:X} !!", o: 8)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_String.TrimEnd_CharArr(s: "Test", c: [' ', ' '])

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_String.Format_OneArg(s: "Testing {0}, {0:C}, {0:E} - {0:F4}{0:G}{0:N} , !!", o: 3.14159)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_String.TrimStart(s: "Test")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_String.ToLower(s: "TEST")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_String.CtorCharCount(size: 10)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_String.ToLower(s: "TeSt")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_String.IndexOfAny

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_String.Remove_Int(s: "dzsdzsDDZSDZSDZSddsz", i: 0)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_String.ToUpper(s: "This is a much longer piece of text that might benefit more from vectorization.")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_String.ToUpper(s: "test")

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Copy link
Author

performanceautofiler bot commented Mar 5, 2024

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.Tests.Perf_PriorityQueue<Guid, Guid>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
233.58 ns 288.36 ns 1.23 0.46 False
10.20 μs 12.23 μs 1.20 0.14 False
4.24 ms 5.14 ms 1.21 0.19 False
282.20 μs 338.56 μs 1.20 0.20 False
258.38 μs 307.89 μs 1.19 0.17 False
28.09 μs 31.01 μs 1.10 0.18 False
43.45 μs 50.08 μs 1.15 0.15 False
9.64 ms 10.82 ms 1.12 0.16 False
1.38 μs 1.74 μs 1.26 0.46 False
13.20 μs 19.34 μs 1.46 0.52 False
660.61 μs 751.95 μs 1.14 0.19 False
8.05 μs 9.37 μs 1.16 0.13 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Tests.Perf_PriorityQueue&lt;Guid, Guid&gt;*'

Payloads

Baseline
Compare

System.Collections.Tests.Perf_PriorityQueue<Guid, Guid>.Enumerate(Size: 10)

ETL Files

Histogram

JIT Disasms

System.Collections.Tests.Perf_PriorityQueue<Guid, Guid>.HeapSort(Size: 10)

ETL Files

Histogram

JIT Disasms

System.Collections.Tests.Perf_PriorityQueue<Guid, Guid>.HeapSort(Size: 1000)

ETL Files

Histogram

JIT Disasms

System.Collections.Tests.Perf_PriorityQueue<Guid, Guid>.K_Max_Elements(Size: 1000)

ETL Files

Histogram

JIT Disasms

System.Collections.Tests.Perf_PriorityQueue<Guid, Guid>.HeapSort(Size: 100)

ETL Files

Histogram

JIT Disasms

System.Collections.Tests.Perf_PriorityQueue<Guid, Guid>.Dequeue_And_Enqueue(Size: 10)

ETL Files

Histogram

JIT Disasms

System.Collections.Tests.Perf_PriorityQueue<Guid, Guid>.K_Max_Elements(Size: 100)

ETL Files

Histogram

JIT Disasms

System.Collections.Tests.Perf_PriorityQueue<Guid, Guid>.Dequeue_And_Enqueue(Size: 1000)

ETL Files

Histogram

JIT Disasms

System.Collections.Tests.Perf_PriorityQueue<Guid, Guid>.Enumerate(Size: 100)

ETL Files

Histogram

JIT Disasms

System.Collections.Tests.Perf_PriorityQueue<Guid, Guid>.Enumerate(Size: 1000)

ETL Files

Histogram

JIT Disasms

System.Collections.Tests.Perf_PriorityQueue<Guid, Guid>.Dequeue_And_Enqueue(Size: 100)

ETL Files

Histogram

JIT Disasms

System.Collections.Tests.Perf_PriorityQueue<Guid, Guid>.K_Max_Elements(Size: 10)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.AddGivenSize<String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
721.91 μs 811.37 μs 1.12 0.19 False
27.22 μs 33.80 μs 1.24 0.46 False
8.75 μs 9.74 μs 1.11 0.51 False
9.93 μs 11.69 μs 1.18 0.48 False
70.07 μs 78.50 μs 1.12 0.41 False
11.56 μs 15.94 μs 1.38 0.56 False
8.41 μs 10.18 μs 1.21 0.47 False

graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.AddGivenSize&lt;String&gt;*'

Payloads

Baseline
Compare

System.Collections.AddGivenSize<String>.SortedList(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.AddGivenSize<String>.HashSet(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.AddGivenSize<String>.List(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.AddGivenSize<String>.Queue(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.AddGivenSize<String>.ObservableCollection(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.AddGivenSize<String>.ICollection(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.AddGivenSize<String>.Stack(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Copy link
Author

performanceautofiler bot commented Mar 5, 2024

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_BigInteger

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
26.16 ns 41.00 ns 1.57 0.69 False
6.21 μs 7.13 μs 1.15 0.05 True
6.09 μs 7.16 μs 1.18 0.05 True
21.15 ns 29.37 ns 1.39 0.73 False
165.95 ns 176.88 ns 1.07 0.06 False
30.74 ns 41.26 ns 1.34 0.66 False
40.89 ns 48.25 ns 1.18 0.58 False
138.60 ns 153.39 ns 1.11 0.15 False
33.39 ns 36.96 ns 1.11 0.60 False
27.89 ns 37.77 ns 1.35 0.64 False
32.28 ns 36.81 ns 1.14 0.62 False
136.53 ns 156.11 ns 1.14 0.21 False
17.95 ns 27.04 ns 1.51 0.71 False
39.82 ns 47.30 ns 1.19 0.52 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_BigInteger*'

Payloads

Baseline
Compare

System.Numerics.Tests.Perf_BigInteger.Equals(arguments: 67 bytes, Same)

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_BigInteger.Subtract(arguments: 65536,65536 bits)

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_BigInteger.Add(arguments: 65536,65536 bits)

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_BigInteger.Ctor_ByteArray(numberString: 123)

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_BigInteger.ModPow(arguments: 16,16,16 bits)

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_BigInteger.Ctor_ByteArray(numberString: -2147483648)

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_BigInteger.Divide(arguments: 16,8 bits)

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_BigInteger.Add(arguments: 1024,1024 bits)

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_BigInteger.Multiply(arguments: 16,16 bits)

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_BigInteger.Equals(arguments: 259 bytes, DiffMiddleByte)

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_BigInteger.Multiply(arguments: 16,8 bits)

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_BigInteger.Subtract(arguments: 1024,1024 bits)

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_BigInteger.Equals(arguments: 67 bytes, DiffFirstByte)

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_BigInteger.Equals(arguments: 259 bytes, Same)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Copy link
Author

performanceautofiler bot commented Mar 5, 2024

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Perf_Ascii

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
29.80 ns 33.82 ns 1.13 0.57 False
32.02 ns 36.82 ns 1.15 0.48 False
127.86 ns 154.87 ns 1.21 0.43 False
209.58 ns 234.06 ns 1.12 0.38 False
34.06 ns 44.69 ns 1.31 0.65 False
39.38 ns 43.27 ns 1.10 0.63 False
203.12 ns 231.84 ns 1.14 0.40 False
26.90 ns 30.46 ns 1.13 0.72 False
27.02 ns 38.42 ns 1.42 0.63 False
27.46 ns 29.18 ns 1.06 0.68 False
21.70 ns 28.48 ns 1.31 0.68 False
109.23 ns 140.67 ns 1.29 0.44 False
189.02 ns 224.61 ns 1.19 0.35 False
19.19 ns 21.85 ns 1.14 0.59 False
188.34 ns 223.50 ns 1.19 0.36 False
103.34 ns 141.03 ns 1.36 0.46 False
34.95 ns 41.26 ns 1.18 0.64 False
128.35 ns 148.63 ns 1.16 0.38 False
34.64 ns 37.88 ns 1.09 0.57 False
26.47 ns 31.17 ns 1.18 0.63 False
20.69 ns 25.53 ns 1.23 0.50 False
103.88 ns 116.08 ns 1.12 0.43 False
32.62 ns 40.55 ns 1.24 0.63 False
22.54 ns 27.70 ns 1.23 0.68 False
49.38 ns 56.56 ns 1.15 0.39 False
8.78 ns 11.73 ns 1.34 0.73 False
55.49 ns 66.71 ns 1.20 0.57 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Perf_Ascii*'

Payloads

Baseline
Compare

System.Text.Perf_Ascii.EqualsIgnoreCase_DifferentCase_Bytes(Size: 6)

ETL Files

Histogram

JIT Disasms

System.Text.Perf_Ascii.ToUtf16(Size: 128)

ETL Files

Histogram

JIT Disasms

System.Text.Perf_Ascii.ToLower_Bytes_Chars(Size: 128)

ETL Files

Histogram

JIT Disasms

System.Text.Perf_Ascii.ToLower_Chars(Size: 128)

ETL Files

Histogram

JIT Disasms

System.Text.Perf_Ascii.Equals_Bytes(Size: 128)

ETL Files

Histogram

JIT Disasms

System.Text.Perf_Ascii.EqualsIgnoreCase_ExactlyTheSame_Bytes(Size: 128)

ETL Files

Histogram

JIT Disasms

System.Text.Perf_Ascii.ToUpper_Chars(Size: 128)

ETL Files

Histogram

JIT Disasms

System.Text.Perf_Ascii.ToLowerInPlace_Bytes(Size: 6)

ETL Files

Histogram

JIT Disasms

System.Text.Perf_Ascii.EqualsIgnoreCase_DifferentCase_Chars(Size: 6)

ETL Files

Histogram

JIT Disasms

System.Text.Perf_Ascii.Equals_Bytes(Size: 6)

ETL Files

Histogram

JIT Disasms

System.Text.Perf_Ascii.Equals_Chars(Size: 6)

ETL Files

Histogram

JIT Disasms

System.Text.Perf_Ascii.ToLower_Bytes(Size: 128)

ETL Files

Histogram

JIT Disasms

System.Text.Perf_Ascii.ToUpperInPlace_Chars(Size: 128)

ETL Files

Histogram

JIT Disasms

System.Text.Perf_Ascii.FromUtf16(Size: 6)

ETL Files

Histogram

JIT Disasms

System.Text.Perf_Ascii.ToLowerInPlace_Chars(Size: 128)

ETL Files

Histogram

JIT Disasms

System.Text.Perf_Ascii.ToLowerInPlace_Bytes(Size: 128)

ETL Files

Histogram

JIT Disasms

System.Text.Perf_Ascii.ToUpper_Bytes_Chars(Size: 6)

ETL Files

Histogram

JIT Disasms

System.Text.Perf_Ascii.ToUpper_Bytes_Chars(Size: 128)

ETL Files

Histogram

JIT Disasms

System.Text.Perf_Ascii.ToUpper_Chars(Size: 6)

ETL Files

Histogram

JIT Disasms

System.Text.Perf_Ascii.EqualsIgnoreCase_ExactlyTheSame_Bytes(Size: 6)

ETL Files

Histogram

JIT Disasms

System.Text.Perf_Ascii.EqualsIgnoreCase_ExactlyTheSame_Bytes_Chars(Size: 6)

ETL Files

Histogram

JIT Disasms

System.Text.Perf_Ascii.ToUpperInPlace_Bytes(Size: 128)

ETL Files

Histogram

JIT Disasms

System.Text.Perf_Ascii.ToUpper_Bytes(Size: 6)

ETL Files

Histogram

JIT Disasms

System.Text.Perf_Ascii.ToUpperInPlace_Bytes(Size: 6)

ETL Files

Histogram

JIT Disasms

System.Text.Perf_Ascii.Equals_Chars(Size: 128)

ETL Files

Histogram

JIT Disasms

System.Text.Perf_Ascii.IsValid_Chars(Size: 6)

ETL Files

Histogram

JIT Disasms

System.Text.Perf_Ascii.EqualsIgnoreCase_DifferentCase_Bytes(Size: 128)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Copy link
Author

performanceautofiler bot commented Mar 5, 2024

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in Microsoft.Extensions.Caching.Memory.Tests.MemoryCacheTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
65.75 μs 74.76 μs 1.14 0.23 False
67.28 μs 74.48 μs 1.11 0.20 False
87.16 μs 97.86 μs 1.12 0.22 False
67.18 μs 74.53 μs 1.11 0.22 False
139.62 ns 159.48 ns 1.14 0.39 False
148.38 ns 162.36 ns 1.09 0.44 False
62.36 μs 71.62 μs 1.15 0.20 False
141.26 ns 151.70 ns 1.07 0.40 False
143.65 ns 165.36 ns 1.15 0.41 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Microsoft.Extensions.Caching.Memory.Tests.MemoryCacheTests*'

Payloads

Baseline
Compare

Microsoft.Extensions.Caching.Memory.Tests.MemoryCacheTests.AddThenRemove_AbsoluteExpiration

ETL Files

Histogram

JIT Disasms

Microsoft.Extensions.Caching.Memory.Tests.MemoryCacheTests.AddThenRemove_RelativeExpiration

ETL Files

Histogram

JIT Disasms

Microsoft.Extensions.Caching.Memory.Tests.MemoryCacheTests.AddThenRemove_ExpirationTokens

ETL Files

Histogram

JIT Disasms

Microsoft.Extensions.Caching.Memory.Tests.MemoryCacheTests.AddThenRemove_SlidingExpiration

ETL Files

Histogram

JIT Disasms

Microsoft.Extensions.Caching.Memory.Tests.MemoryCacheTests.TryGetValueHit

ETL Files

Histogram

JIT Disasms

Microsoft.Extensions.Caching.Memory.Tests.MemoryCacheTests.GetMiss

ETL Files

Histogram

JIT Disasms

Microsoft.Extensions.Caching.Memory.Tests.MemoryCacheTests.AddThenRemove_NoExpiration

ETL Files

Histogram

JIT Disasms

Microsoft.Extensions.Caching.Memory.Tests.MemoryCacheTests.TryGetValueMiss

ETL Files

Histogram

JIT Disasms

Microsoft.Extensions.Caching.Memory.Tests.MemoryCacheTests.GetHit

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.CreateAddAndRemove<String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
2.72 ms 3.10 ms 1.14 0.14 False
83.86 μs 101.54 μs 1.21 0.22 False
1.30 ms 1.41 ms 1.08 0.16 False
17.76 μs 20.69 μs 1.17 0.50 False
21.07 μs 22.74 μs 1.08 0.44 False

graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CreateAddAndRemove&lt;String&gt;*'

Payloads

Baseline
Compare

System.Collections.CreateAddAndRemove<String>.SortedDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.CreateAddAndRemove<String>.Dictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.CreateAddAndRemove<String>.SortedList(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.CreateAddAndRemove<String>.Stack(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.CreateAddAndRemove<String>.Queue(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_HashCode

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
62.06 μs 69.00 μs 1.11 0.30 False
8.35 μs 11.27 μs 1.35 0.55 False
54.89 μs 62.74 μs 1.14 0.37 False
110.91 μs 118.87 μs 1.07 0.36 False
92.41 μs 102.17 μs 1.11 0.32 False

graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_HashCode*'

Payloads

Baseline
Compare

System.Tests.Perf_HashCode.Combine_2

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_HashCode.Add

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_HashCode.Combine_1

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_HashCode.Combine_6

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_HashCode.Combine_4

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Copy link
Author

performanceautofiler bot commented Mar 5, 2024

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Memory.Span<Byte>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
8.96 ns 19.02 ns 2.12 0.87 False
3.11 ns 4.47 ns 1.44 0.49 False
23.00 ns 37.18 ns 1.62 0.55 False
17.71 ns 20.33 ns 1.15 0.71 False
23.51 ns 29.24 ns 1.24 0.67 False
14.32 ns 28.14 ns 1.97 0.76 False
40.38 ns 44.84 ns 1.11 0.60 False
58.56 ns 62.76 ns 1.07 0.47 False
27.56 ns 39.81 ns 1.44 0.63 False
14.83 ns 18.25 ns 1.23 0.74 False
10.73 ns 34.26 ns 3.19 0.74 True
36.30 ns 46.48 ns 1.28 0.68 False
10.17 ns 16.18 ns 1.59 0.75 False
9.05 ns 11.99 ns 1.32 0.71 False
8.13 ns 20.41 ns 2.51 0.84 False
11.12 ns 13.96 ns 1.26 0.69 False
34.00 ns 48.17 ns 1.42 0.58 False
19.85 ns 28.03 ns 1.41 0.74 False
29.98 ns 42.18 ns 1.41 0.74 False
39.36 ns 49.63 ns 1.26 0.63 False
23.62 ns 37.56 ns 1.59 0.59 False
9.07 ns 13.65 ns 1.51 0.72 False
25.82 ns 33.29 ns 1.29 0.57 False
11.55 ns 14.61 ns 1.26 0.77 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.Span&lt;Byte&gt;*'

Payloads

Baseline
Compare

System.Memory.Span<Byte>.Fill(Size: 4)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Byte>.GetPinnableReference(Size: 4)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Byte>.ToArray(Size: 33)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Byte>.LastIndexOfValue(Size: 33)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Byte>.SequenceCompareTo(Size: 4)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Byte>.Reverse(Size: 33)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Byte>.IndexOfAnyFiveValues(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Byte>.SequenceCompareTo(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Byte>.IndexOfAnyThreeValues(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Byte>.IndexOfAnyFiveValues(Size: 4)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Byte>.Fill(Size: 33)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Byte>.Reverse(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Byte>.IndexOfAnyTwoValues(Size: 33)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Byte>.LastIndexOfAnyValues(Size: 4)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Byte>.Clear(Size: 4)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Byte>.IndexOfValue(Size: 4)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Byte>.IndexOfAnyFourValues(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Byte>.SequenceCompareTo(Size: 33)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Byte>.LastIndexOfValue(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Byte>.Fill(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Byte>.IndexOfAnyTwoValues(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Byte>.IndexOfAnyThreeValues(Size: 4)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Byte>.LastIndexOfAnyValues(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Byte>.IndexOfAnyThreeValues(Size: 33)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Node.Tests.Perf_ParseThenWrite

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
14.34 ms 16.03 ms 1.12 0.16 False
15.35 ms 16.53 ms 1.08 0.16 False
197.40 μs 216.20 μs 1.10 0.16 False
186.20 μs 216.44 μs 1.16 0.12 False
31.79 μs 35.05 μs 1.10 0.19 False
100.47 μs 108.80 μs 1.08 0.13 False
21.86 μs 24.43 μs 1.12 0.13 False
153.02 μs 166.11 μs 1.09 0.15 False
45.13 μs 50.76 μs 1.12 0.12 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Node.Tests.Perf_ParseThenWrite*'

Payloads

Baseline
Compare

System.Text.Json.Node.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: False, TestCase: Json400KB)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Node.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: True, TestCase: Json400KB)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Node.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: True, TestCase: BroadTree)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Node.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: False, TestCase: BroadTree)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Node.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: False, TestCase: LotsOfStrings)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Node.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: False, TestCase: DeepTree)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Node.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: True, TestCase: Json400B)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Node.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: True, TestCase: Json4KB)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Node.Tests.Perf_ParseThenWrite.ParseThenWrite(IsDataIndented: False, TestCase: LotsOfNumbers)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Copy link
Author

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_Half

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
8.58 ns 10.65 ns 1.24 0.75 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Half*'

Payloads

Baseline
Compare

System.Tests.Perf_Half.SingleToHalf(value: 6.097555E-05)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Buffers.Tests.ReadOnlySequenceTests<Char>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
31.84 ns 42.09 ns 1.32 0.65 False
420.50 ns 573.85 ns 1.36 0.48 False
79.44 ns 87.80 ns 1.11 0.46 False
135.98 ns 156.37 ns 1.15 0.54 False
22.23 ns 26.28 ns 1.18 0.63 False
81.77 ns 96.78 ns 1.18 0.47 False
486.15 ns 551.60 ns 1.13 0.50 False
320.95 ns 352.93 ns 1.10 0.57 False
42.35 ns 47.07 ns 1.11 0.61 False
30.91 ns 37.45 ns 1.21 0.68 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Tests.ReadOnlySequenceTests&lt;Char&gt;*'

Payloads

Baseline
Compare

System.Buffers.Tests.ReadOnlySequenceTests<Char>.FirstArray

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.ReadOnlySequenceTests<Char>.IterateGetPositionArray

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.ReadOnlySequenceTests<Char>.SliceArray

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.ReadOnlySequenceTests<Char>.IterateTryGetMemory

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.ReadOnlySequenceTests<Char>.FirstSpanSingleSegment

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.ReadOnlySequenceTests<Char>.SliceMemory

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.ReadOnlySequenceTests<Char>.IterateGetPositionMemory

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.ReadOnlySequenceTests<Char>.IterateTryGetTenSegments

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.ReadOnlySequenceTests<Char>.FirstMemory

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.ReadOnlySequenceTests<Char>.FirstSpanMemory

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.ContainsFalse<String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
5.39 ms 7.08 ms 1.31 0.57 False
122.74 μs 132.67 μs 1.08 0.26 False
5.40 ms 7.15 ms 1.32 0.48 False
2.85 ms 3.84 ms 1.35 0.43 False
26.03 μs 32.52 μs 1.25 0.41 False
5.76 ms 6.90 ms 1.20 0.56 False
5.51 ms 6.43 ms 1.17 0.52 False
5.53 ms 7.83 ms 1.42 0.51 False
5.48 ms 7.94 ms 1.45 0.47 False
5.51 ms 6.96 ms 1.26 0.57 False
27.26 μs 31.65 μs 1.16 0.44 False
9.26 ms 12.00 ms 1.30 0.54 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsFalse&lt;String&gt;*'

Payloads

Baseline
Compare

System.Collections.ContainsFalse<String>.List(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsFalse<String>.ImmutableHashSet(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsFalse<String>.Queue(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsFalse<String>.Span(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsFalse<String>.FrozenSet(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsFalse<String>.Array(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsFalse<String>.Stack(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsFalse<String>.ICollection(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsFalse<String>.LinkedList(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsFalse<String>.ImmutableArray(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsFalse<String>.HashSet(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsFalse<String>.ImmutableList(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.Perf_Frozen<ReferenceType>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
174.63 μs 186.10 μs 1.07 0.12 False
41.50 μs 60.52 μs 1.46 0.56 False
449.54 ns 619.53 ns 1.38 0.57 False
770.91 ns 873.39 ns 1.13 0.26 False
4.87 μs 7.17 μs 1.47 0.53 False
36.63 μs 49.82 μs 1.36 0.53 False
4.57 μs 6.63 μs 1.45 0.56 False
20.35 μs 22.58 μs 1.11 0.16 False
379.57 ns 586.54 ns 1.55 0.62 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Perf_Frozen&lt;ReferenceType&gt;*'

Payloads

Baseline
Compare

System.Collections.Perf_Frozen<ReferenceType>.ToFrozenSet(Count: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_Frozen<ReferenceType>.TryGetValue_True(Count: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_Frozen<ReferenceType>.Contains_True(Count: 4)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_Frozen<ReferenceType>.ToFrozenSet(Count: 4)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_Frozen<ReferenceType>.TryGetValue_True(Count: 64)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_Frozen<ReferenceType>.Contains_True(Count: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_Frozen<ReferenceType>.Contains_True(Count: 64)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_Frozen<ReferenceType>.ToFrozenSet(Count: 64)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_Frozen<ReferenceType>.TryGetValue_True(Count: 4)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Copy link
Author

performanceautofiler bot commented Mar 5, 2024

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.Perf_SubstringFrozenDictionary

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
2.80 ms 3.12 ms 1.11 0.19 False
573.08 ns 606.74 ns 1.06 0.60 False
621.23 μs 733.37 μs 1.18 0.32 False
38.73 μs 48.58 μs 1.25 0.33 False
399.30 ns 511.44 ns 1.28 0.48 False
3.61 μs 4.24 μs 1.18 0.39 False
229.28 μs 264.24 μs 1.15 0.18 False
58.32 μs 65.93 μs 1.13 0.46 False
5.12 μs 6.10 μs 1.19 0.54 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Perf_SubstringFrozenDictionary*'

Payloads

Baseline
Compare

System.Collections.Perf_SubstringFrozenDictionary.ToFrozenDictionary(Count: 10000)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_SubstringFrozenDictionary.TryGetValue_True_FrozenDictionary(Count: 10)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_SubstringFrozenDictionary.TryGetValue_True_FrozenDictionary(Count: 10000)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_SubstringFrozenDictionary.TryGetValue_False_FrozenDictionary(Count: 1000)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_SubstringFrozenDictionary.TryGetValue_False_FrozenDictionary(Count: 10)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_SubstringFrozenDictionary.TryGetValue_False_FrozenDictionary(Count: 100)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_SubstringFrozenDictionary.ToFrozenDictionary(Count: 1000)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_SubstringFrozenDictionary.TryGetValue_True_FrozenDictionary(Count: 1000)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_SubstringFrozenDictionary.TryGetValue_True_FrozenDictionary(Count: 100)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.ContainsTrue<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
22.04 μs 24.50 μs 1.11 0.63 False
4.54 ms 5.38 ms 1.18 0.45 False
115.42 μs 127.71 μs 1.11 0.23 False
672.64 μs 799.60 μs 1.19 0.20 False
42.07 μs 48.59 μs 1.16 0.49 False
58.37 μs 72.13 μs 1.24 0.27 False

graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsTrue&lt;Int32&gt;*'

Payloads

Baseline
Compare

System.Collections.ContainsTrue<Int32>.HashSet(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsTrue<Int32>.ImmutableList(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsTrue<Int32>.ImmutableHashSet(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsTrue<Int32>.LinkedList(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsTrue<Int32>.Stack(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsTrue<Int32>.SortedSet(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.CtorFromCollection<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
19.08 μs 21.91 μs 1.15 0.43 False
38.84 μs 43.60 μs 1.12 0.11 False
26.19 μs 32.67 μs 1.25 0.41 False
142.76 μs 162.06 μs 1.14 0.19 False
22.40 μs 28.37 μs 1.27 0.39 False
583.64 μs 642.50 μs 1.10 0.15 False
833.54 μs 925.52 μs 1.11 0.10 False
1.41 ms 1.79 ms 1.27 0.23 False
25.70 μs 32.52 μs 1.27 0.57 False
1.38 ms 1.61 ms 1.16 0.16 False
95.07 μs 106.83 μs 1.12 0.32 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CtorFromCollection&lt;Int32&gt;*'

Payloads

Baseline
Compare

System.Collections.CtorFromCollection<Int32>.ConcurrentStack(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.CtorFromCollection<Int32>.SortedSet(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.CtorFromCollection<Int32>.LinkedList(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.CtorFromCollection<Int32>.ImmutableSortedSet(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.CtorFromCollection<Int32>.ImmutableStack(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.CtorFromCollection<Int32>.SortedDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.CtorFromCollection<Int32>.ImmutableSortedDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.CtorFromCollection<Int32>.ImmutableHashSet(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.CtorFromCollection<Int32>.HashSet(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.CtorFromCollection<Int32>.ImmutableDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.CtorFromCollection<Int32>.SortedDictionaryDeepCopy(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Copy link
Author

performanceautofiler bot commented Mar 5, 2024

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Serialization.Tests.WriteJson<Hashtable>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
49.12 μs 55.19 μs 1.12 0.10 False
44.61 μs 51.90 μs 1.16 0.10 False
44.76 μs 51.20 μs 1.14 0.14 False
48.20 μs 54.84 μs 1.14 0.13 False
42.04 μs 49.49 μs 1.18 0.12 False
43.32 μs 49.27 μs 1.14 0.14 False
48.85 μs 55.58 μs 1.14 0.13 False
48.88 μs 54.74 μs 1.12 0.12 False

graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson&lt;Hashtable&gt;*'

Payloads

Baseline
Compare

System.Text.Json.Serialization.Tests.WriteJson<Hashtable>.SerializeObjectProperty(Mode: Reflection)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.WriteJson<Hashtable>.SerializeToUtf8Bytes(Mode: Reflection)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.WriteJson<Hashtable>.SerializeToUtf8Bytes(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.WriteJson<Hashtable>.SerializeToString(Mode: Reflection)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.WriteJson<Hashtable>.SerializeToWriter(Mode: Reflection)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.WriteJson<Hashtable>.SerializeToWriter(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.WriteJson<Hashtable>.SerializeToString(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.WriteJson<Hashtable>.SerializeObjectProperty(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.TryAddGiventSize<String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
37.73 μs 43.14 μs 1.14 0.26 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.TryAddGiventSize&lt;String&gt;*'

Payloads

Baseline
Compare

System.Collections.TryAddGiventSize<String>.Dictionary(Count: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.IO.Tests.BinaryWriterTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
12.42 ns 24.01 ns 1.93 0.74 False
17.35 ns 34.09 ns 1.97 0.69 False
17.88 ns 25.27 ns 1.41 0.72 False
22.54 ns 31.78 ns 1.41 0.72 False
18.77 ns 24.29 ns 1.29 0.74 False
22.55 ns 31.81 ns 1.41 0.67 False
17.04 ns 28.56 ns 1.68 0.71 False
20.09 ns 28.33 ns 1.41 0.68 False

graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.IO.Tests.BinaryWriterTests*'

Payloads

Baseline
Compare

System.IO.Tests.BinaryWriterTests.WriteBool

ETL Files

Histogram

JIT Disasms

System.IO.Tests.BinaryWriterTests.WriteUInt64

ETL Files

Histogram

JIT Disasms

System.IO.Tests.BinaryWriterTests.WriteSingle

ETL Files

Histogram

JIT Disasms

System.IO.Tests.BinaryWriterTests.WriteNonAsciiChar

ETL Files

Histogram

JIT Disasms

System.IO.Tests.BinaryWriterTests.WriteUInt32

ETL Files

Histogram

JIT Disasms

System.IO.Tests.BinaryWriterTests.WriteHalf

ETL Files

Histogram

JIT Disasms

System.IO.Tests.BinaryWriterTests.WriteDouble

ETL Files

Histogram

JIT Disasms

System.IO.Tests.BinaryWriterTests.WriteAsciiChar

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in MicroBenchmarks.Serializers.Xml_ToStream<LoginViewModel>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
2.30 μs 2.65 μs 1.15 0.24 False
3.52 μs 4.04 μs 1.15 0.14 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'MicroBenchmarks.Serializers.Xml_ToStream&lt;LoginViewModel&gt;*'

Payloads

Baseline
Compare

MicroBenchmarks.Serializers.Xml_ToStream<LoginViewModel>.DataContractSerializer_BinaryXml_

ETL Files

Histogram

JIT Disasms

MicroBenchmarks.Serializers.Xml_ToStream<LoginViewModel>.DataContractSerializer_

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Document.Tests.Perf_DocumentParse

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
980.13 ns 1.06 μs 1.08 0.15 False
6.15 μs 7.00 μs 1.14 0.15 False
2.12 μs 2.48 μs 1.17 0.20 False
10.13 μs 11.10 μs 1.10 0.16 False
1.46 μs 1.65 μs 1.13 0.22 False
2.44 μs 2.81 μs 1.15 0.15 False

graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Document.Tests.Perf_DocumentParse*'

Payloads

Baseline
Compare

System.Text.Json.Document.Tests.Perf_DocumentParse.Parse(IsDataIndented: True, TestRandomAccess: False, TestCase: HelloWorld)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Document.Tests.Perf_DocumentParse.Parse(IsDataIndented: True, TestRandomAccess: True, TestCase: BasicJson)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Document.Tests.Perf_DocumentParse.Parse(IsDataIndented: False, TestRandomAccess: False, TestCase: BasicJson)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Document.Tests.Perf_DocumentParse.Parse(IsDataIndented: True, TestRandomAccess: True, TestCase: Json400B)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Document.Tests.Perf_DocumentParse.Parse(IsDataIndented: True, TestRandomAccess: True, TestCase: HelloWorld)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Document.Tests.Perf_DocumentParse.Parse(IsDataIndented: True, TestRandomAccess: False, TestCase: BasicJson)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Copy link
Author

performanceautofiler bot commented Mar 5, 2024

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.MathBenchmarks.Single

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
56.91 μs 63.08 μs 1.11 0.10 False
43.15 μs 49.61 μs 1.15 0.40 False
20.70 μs 27.14 μs 1.31 0.02 False
60.89 μs 65.43 μs 1.07 0.08 False
42.37 μs 62.61 μs 1.48 0.33 False
19.28 μs 24.31 μs 1.26 0.14 False
22.88 μs 26.60 μs 1.16 0.08 False
50.41 μs 53.64 μs 1.06 0.02 False
29.59 μs 33.36 μs 1.13 0.12 False
51.97 μs 56.67 μs 1.09 0.00 False
97.17 μs 109.21 μs 1.12 0.14 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.MathBenchmarks.Single*'

Payloads

Baseline
Compare

System.MathBenchmarks.Single.TanPi

ETL Files

Histogram

JIT Disasms

System.MathBenchmarks.Single.LogP1

ETL Files

Histogram

JIT Disasms

System.MathBenchmarks.Single.Round

ETL Files

Histogram

JIT Disasms

System.MathBenchmarks.Single.AtanPi

ETL Files

Histogram

JIT Disasms

System.MathBenchmarks.Single.Log

ETL Files

Histogram

JIT Disasms

System.MathBenchmarks.Single.ILogB

ETL Files

Histogram

JIT Disasms

System.MathBenchmarks.Single.ScaleB

ETL Files

Histogram

JIT Disasms

System.MathBenchmarks.Single.Acos

ETL Files

Histogram

JIT Disasms

System.MathBenchmarks.Single.Hypot

ETL Files

Histogram

JIT Disasms

System.MathBenchmarks.Single.Cbrt

ETL Files

Histogram

JIT Disasms

System.MathBenchmarks.Single.SinCosPi

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in Microsoft.Extensions.DependencyInjection.GetService

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
193.52 ns 251.46 ns 1.30 0.36 False
116.47 ns 158.88 ns 1.36 0.49 False
116.15 ns 154.10 ns 1.33 0.51 False
117.57 ns 170.87 ns 1.45 0.45 False
627.97 ns 730.89 ns 1.16 0.22 False

graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Microsoft.Extensions.DependencyInjection.GetService*'

Payloads

Baseline
Compare

Microsoft.Extensions.DependencyInjection.GetService.ServiceScope

ETL Files

Histogram

JIT Disasms

Microsoft.Extensions.DependencyInjection.GetService.ServiceScopeProvider

ETL Files

Histogram

JIT Disasms

Microsoft.Extensions.DependencyInjection.GetService.Singleton

ETL Files

Histogram

JIT Disasms

Microsoft.Extensions.DependencyInjection.GetService.EmptyEnumerable

ETL Files

Histogram

JIT Disasms

Microsoft.Extensions.DependencyInjection.GetService.Scoped

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Xml.Linq.Perf_XName

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
147.05 ns 169.51 ns 1.15 0.41 False
284.08 ns 331.99 ns 1.17 0.27 False
282.10 ns 322.52 ns 1.14 0.31 False

graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Xml.Linq.Perf_XName*'

Payloads

Baseline
Compare

System.Xml.Linq.Perf_XName.CreateElement

ETL Files

Histogram

JIT Disasms

System.Xml.Linq.Perf_XName.CreateElementWithNamespaceImplicitOperator

ETL Files

Histogram

JIT Disasms

System.Xml.Linq.Perf_XName.CreateElementWithNamespace

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.ContainsKeyTrue<String, String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
44.55 μs 47.09 μs 1.06 0.48 False
35.10 μs 43.36 μs 1.24 0.44 False
532.84 μs 621.38 μs 1.17 0.27 False
1.05 ms 1.28 ms 1.22 0.15 False
31.77 μs 46.06 μs 1.45 0.46 False
146.23 μs 178.49 μs 1.22 0.30 False
36.26 μs 47.81 μs 1.32 0.49 False

graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsKeyTrue&lt;String, String&gt;*'

Payloads

Baseline
Compare

System.Collections.ContainsKeyTrue<String, String>.IDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsKeyTrue<String, String>.FrozenDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsKeyTrue<String, String>.SortedList(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsKeyTrue<String, String>.SortedDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsKeyTrue<String, String>.ConcurrentDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsKeyTrue<String, String>.ImmutableDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsKeyTrue<String, String>.Dictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Hashing

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
22.16 ns 26.79 ns 1.21 0.72 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Hashing*'

Payloads

Baseline
Compare

System.Hashing.GetStringHashCode(BytesCount: 10)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Copy link
Author

performanceautofiler bot commented Mar 5, 2024

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.IterateForEach<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
97.58 μs 108.56 μs 1.11 0.17 False
8.08 μs 9.45 μs 1.17 0.40 False
11.02 μs 13.77 μs 1.25 0.49 False
372.67 μs 445.07 μs 1.19 0.20 False
362.49 μs 406.56 μs 1.12 0.24 False
147.68 μs 156.57 μs 1.06 0.30 False
7.48 μs 9.26 μs 1.24 0.43 False
25.97 μs 32.38 μs 1.25 0.48 False
101.01 μs 120.36 μs 1.19 0.30 False
122.08 μs 133.05 μs 1.09 0.18 False
56.83 μs 67.75 μs 1.19 0.35 False
26.73 μs 33.23 μs 1.24 0.53 False
53.44 μs 68.48 μs 1.28 0.29 False
7.22 μs 8.26 μs 1.14 0.42 False
134.56 μs 150.24 μs 1.12 0.28 False
7.19 μs 8.24 μs 1.15 0.41 False
30.91 μs 37.63 μs 1.22 0.40 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.IterateForEach&lt;Int32&gt;*'

Payloads

Baseline
Compare

System.Collections.IterateForEach<Int32>.SortedList(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.IterateForEach<Int32>.Queue(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.IterateForEach<Int32>.IEnumerable(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.IterateForEach<Int32>.ImmutableHashSet(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.IterateForEach<Int32>.ImmutableDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.IterateForEach<Int32>.ImmutableSortedDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.IterateForEach<Int32>.Stack(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.IterateForEach<Int32>.ImmutableStack(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.IterateForEach<Int32>.ConcurrentQueue(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.IterateForEach<Int32>.ConcurrentDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.IterateForEach<Int32>.ConcurrentStack(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.IterateForEach<Int32>.ImmutableQueue(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.IterateForEach<Int32>.ConcurrentBag(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.IterateForEach<Int32>.List(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.IterateForEach<Int32>.ImmutableSortedSet(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.IterateForEach<Int32>.FrozenSet(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.IterateForEach<Int32>.SortedSet(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in MicroBenchmarks.Serializers.Xml_ToStream<SimpleStructWithProperties>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
1.96 μs 2.30 μs 1.17 0.28 False
2.98 μs 3.69 μs 1.24 0.21 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'MicroBenchmarks.Serializers.Xml_ToStream&lt;SimpleStructWithProperties&gt;*'

Payloads

Baseline
Compare

MicroBenchmarks.Serializers.Xml_ToStream<SimpleStructWithProperties>.DataContractSerializer_BinaryXml_

ETL Files

Histogram

JIT Disasms

MicroBenchmarks.Serializers.Xml_ToStream<SimpleStructWithProperties>.DataContractSerializer_

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.ContainsTrueComparer<String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
76.98 μs 84.55 μs 1.10 0.49 False
725.96 μs 794.59 μs 1.09 0.31 False
60.34 μs 80.67 μs 1.34 0.52 False
678.57 μs 776.65 μs 1.14 0.30 False
158.56 μs 179.43 μs 1.13 0.28 False

graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsTrueComparer&lt;String&gt;*'

Payloads

Baseline
Compare

System.Collections.ContainsTrueComparer<String>.FrozenSet(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsTrueComparer<String>.ImmutableSortedSet(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsTrueComparer<String>.HashSet(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsTrueComparer<String>.SortedSet(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsTrueComparer<String>.ImmutableHashSet(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.ContainsKeyFalse<String, String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
26.17 μs 28.83 μs 1.10 0.50 False
705.38 μs 761.94 μs 1.08 0.25 False
31.41 μs 38.95 μs 1.24 0.39 False
29.01 μs 36.01 μs 1.24 0.39 False
121.27 μs 138.30 μs 1.14 0.36 False
1.30 ms 1.52 ms 1.16 0.21 False
27.35 μs 34.98 μs 1.28 0.47 False

graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsKeyFalse&lt;String, String&gt;*'

Payloads

Baseline
Compare

System.Collections.ContainsKeyFalse<String, String>.ConcurrentDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsKeyFalse<String, String>.SortedList(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsKeyFalse<String, String>.IDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsKeyFalse<String, String>.FrozenDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsKeyFalse<String, String>.ImmutableDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsKeyFalse<String, String>.SortedDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsKeyFalse<String, String>.Dictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Copy link
Author

performanceautofiler bot commented Mar 5, 2024

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_Int32

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
51.96 ns 65.54 ns 1.26 0.68 False
67.50 ns 90.33 ns 1.34 0.59 False
53.16 ns 63.46 ns 1.19 0.60 False
64.36 ns 79.12 ns 1.23 0.59 False
54.68 ns 64.00 ns 1.17 0.59 False
44.00 ns 52.00 ns 1.18 0.65 False
19.94 ns 32.03 ns 1.61 0.75 False
44.11 ns 52.26 ns 1.18 0.62 False
41.03 ns 47.86 ns 1.17 0.60 False
65.45 ns 85.63 ns 1.31 0.61 False
47.79 ns 52.26 ns 1.09 0.64 False
45.59 ns 61.04 ns 1.34 0.58 False
52.91 ns 65.33 ns 1.23 0.60 False
88.87 ns 106.94 ns 1.20 0.33 False
18.13 ns 22.94 ns 1.27 0.76 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Int32*'

Payloads

Baseline
Compare

System.Tests.Perf_Int32.ParseSpan(value: "-2147483648")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Int32.ParseHex(value: "80000000")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Int32.Parse(value: "4")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Int32.ParseHex(value: "4")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Int32.ParseSpan(value: "2147483647")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Int32.TryParse(value: "4")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Int32.TryFormat(value: 4)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Int32.TryParseSpan(value: "12345")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Int32.TryParseSpan(value: "4")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Int32.ParseHex(value: "3039")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Int32.ParseSpan(value: "4")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Int32.TryParseSpan(value: "2147483647")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Int32.TryParseSpan(value: "-2147483648")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Int32.ToString(value: -2147483648)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Int32.ToString(value: 4)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Encodings.Web.Tests.Perf_Encoders

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
265.54 ns 304.06 ns 1.15 0.12 False
148.19 ns 161.06 ns 1.09 0.18 False
121.91 ns 155.41 ns 1.27 0.33 False
4.56 μs 5.13 μs 1.12 0.10 False
174.83 ns 197.29 ns 1.13 0.08 False
307.65 ns 341.75 ns 1.11 0.08 False
364.78 ns 442.46 ns 1.21 0.13 False
4.61 μs 4.98 μs 1.08 0.10 False
4.64 μs 5.84 μs 1.26 0.08 True
4.70 μs 5.07 μs 1.08 0.07 False
4.69 μs 5.12 μs 1.09 0.07 False
4.72 μs 6.03 μs 1.28 0.08 True
399.58 ns 509.63 ns 1.28 0.11 False
112.96 ns 129.86 ns 1.15 0.26 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Encodings.Web.Tests.Perf_Encoders*'

Payloads

Baseline
Compare

System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: JavaScript,&Hello+<World>!,16)

ETL Files

Histogram

JIT Disasms

System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: JavaScript,&Hello+<World>!,16)

ETL Files

Histogram

JIT Disasms

System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: Url,�2020,16)

ETL Files

Histogram

JIT Disasms

System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: JavaScript,&Hello+<World>!,512)

ETL Files

Histogram

JIT Disasms

System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: Url,&lorem ipsum=dolor sit amet,16)

ETL Files

Histogram

JIT Disasms

System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: Url,&lorem ipsum=dolor sit amet,16)

ETL Files

Histogram

JIT Disasms

System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: JavaScript,no escaping required,16)

ETL Files

Histogram

JIT Disasms

System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: Url,�2020,512)

ETL Files

Histogram

JIT Disasms

System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: UnsafeRelaxed,hello "there",512)

ETL Files

Histogram

JIT Disasms

System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: Url,&lorem ipsum=dolor sit amet,512)

ETL Files

Histogram

JIT Disasms

System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: JavaScript,no escaping required,512)

ETL Files

Histogram

JIT Disasms

System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: UnsafeRelaxed,no <escaping /> required,512)

ETL Files

Histogram

JIT Disasms

System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf8(arguments: UnsafeRelaxed,no <escaping /> required,16)

ETL Files

Histogram

JIT Disasms

System.Text.Encodings.Web.Tests.Perf_Encoders.EncodeUtf16(arguments: UnsafeRelaxed,hello "there",16)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Copy link
Author

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Tests.Utf8JsonReaderCommentsTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
2.21 μs 2.46 μs 1.11 0.43 False
232.25 ns 279.47 ns 1.20 0.28 False
241.56 ns 268.26 ns 1.11 0.32 False
186.65 ns 212.17 ns 1.14 0.34 False
249.76 ns 279.01 ns 1.12 0.26 False
195.31 ns 215.23 ns 1.10 0.29 False

graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Tests.Utf8JsonReaderCommentsTests*'

Payloads

Baseline
Compare

System.Text.Json.Tests.Utf8JsonReaderCommentsTests.Utf8JsonReaderCommentParsing(CommentHandling: Skip, SegmentSize: 100, TestCase: LongSingleLine)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Tests.Utf8JsonReaderCommentsTests.Utf8JsonReaderCommentParsing(CommentHandling: Skip, SegmentSize: 100, TestCase: ShortSingleLine)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Tests.Utf8JsonReaderCommentsTests.Utf8JsonReaderCommentParsing(CommentHandling: Allow, SegmentSize: 100, TestCase: ShortSingleLine)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Tests.Utf8JsonReaderCommentsTests.Utf8JsonReaderCommentParsing(CommentHandling: Allow, SegmentSize: 0, TestCase: ShortSingleLine)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Tests.Utf8JsonReaderCommentsTests.Utf8JsonReaderCommentParsing(CommentHandling: Allow, SegmentSize: 100, TestCase: ShortMultiLine)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Tests.Utf8JsonReaderCommentsTests.Utf8JsonReaderCommentParsing(CommentHandling: Allow, SegmentSize: 0, TestCase: ShortMultiLine)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in MicroBenchmarks.Serializers.Xml_FromStream<ClassImplementingIXmlSerialiable>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
2.78 μs 3.06 μs 1.10 0.15 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'MicroBenchmarks.Serializers.Xml_FromStream&lt;ClassImplementingIXmlSerialiable&gt;*'

Payloads

Baseline
Compare

MicroBenchmarks.Serializers.Xml_FromStream<ClassImplementingIXmlSerialiable>.DataContractSerializer_BinaryXml_

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in GuardedDevirtualization.TwoClassVirtual

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
5.29 ns 6.52 ns 1.23 0.22 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'GuardedDevirtualization.TwoClassVirtual*'

Payloads

Baseline
Compare

GuardedDevirtualization.TwoClassVirtual.Call(testInput: pB = 0.90)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_Byte

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
18.38 ns 29.00 ns 1.58 0.78 False
36.41 ns 45.97 ns 1.26 0.61 False
56.61 ns 66.71 ns 1.18 0.58 False
56.70 ns 63.35 ns 1.12 0.64 False

graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Byte*'

Payloads

Baseline
Compare

System.Tests.Perf_Byte.ToString(value: 0)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Byte.TryParse(value: "0")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Byte.Parse(value: "0")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Byte.Parse(value: "255")

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
24.40 ns 37.19 ns 1.52 0.70 False
15.38 ns 21.61 ns 1.41 0.70 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt64&gt;*'

Payloads

Baseline
Compare

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.SquareRootBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt64>.DivisionOperatorBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Serialization.Tests.ReadJson<HashSet<String>>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
35.56 μs 42.67 μs 1.20 0.14 False
38.24 μs 42.84 μs 1.12 0.12 False
37.52 μs 43.95 μs 1.17 0.18 False
35.68 μs 39.59 μs 1.11 0.15 False
43.50 μs 49.92 μs 1.15 0.14 False
42.56 μs 51.55 μs 1.21 0.14 False

graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.ReadJson&lt;HashSet&lt;String&gt;&gt;*'

Payloads

Baseline
Compare

System.Text.Json.Serialization.Tests.ReadJson<HashSet<String>>.DeserializeFromUtf8Bytes(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.ReadJson<HashSet<String>>.DeserializeFromString(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.ReadJson<HashSet<String>>.DeserializeFromString(Mode: Reflection)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.ReadJson<HashSet<String>>.DeserializeFromUtf8Bytes(Mode: Reflection)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.ReadJson<HashSet<String>>.DeserializeFromReader(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.ReadJson<HashSet<String>>.DeserializeFromReader(Mode: Reflection)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.Sort<String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
686.19 μs 736.82 μs 1.07 0.19 False
626.80 μs 707.83 μs 1.13 0.17 False
626.98 μs 677.87 μs 1.08 0.20 False
745.15 μs 821.13 μs 1.10 0.26 False
739.35 μs 823.52 μs 1.11 0.27 False
685.15 μs 746.93 μs 1.09 0.20 False
753.15 μs 826.72 μs 1.10 0.27 False

graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Sort&lt;String&gt;*'

Payloads

Baseline
Compare

System.Collections.Sort<String>.LinqQuery(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.Sort<String>.List(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.Sort<String>.Array(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.Sort<String>.Array_Comparison(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.Sort<String>.Array_ComparerClass(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.Sort<String>.LinqOrderByExtension(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.Sort<String>.Array_ComparerStruct(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Copy link
Author

performanceautofiler bot commented Mar 5, 2024

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.IO.Tests.StreamReaderReadToEndTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
65.51 ms 71.06 ms 1.08 0.09 False
64.55 ms 71.87 ms 1.11 0.16 False
66.16 ms 73.80 ms 1.12 0.10 False
65.29 ms 79.19 ms 1.21 0.15 False
64.94 ms 76.54 ms 1.18 0.16 False

graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.IO.Tests.StreamReaderReadToEndTests*'

Payloads

Baseline
Compare

System.IO.Tests.StreamReaderReadToEndTests.ReadToEnd(LineLengthRange: [ 1, 8])

ETL Files

Histogram

JIT Disasms

System.IO.Tests.StreamReaderReadToEndTests.ReadToEnd(LineLengthRange: [ 0, 1024])

ETL Files

Histogram

JIT Disasms

System.IO.Tests.StreamReaderReadToEndTests.ReadToEnd(LineLengthRange: [ 1, 1])

ETL Files

Histogram

JIT Disasms

System.IO.Tests.StreamReaderReadToEndTests.ReadToEnd(LineLengthRange: [ 33, 128])

ETL Files

Histogram

JIT Disasms

System.IO.Tests.StreamReaderReadToEndTests.ReadToEnd(LineLengthRange: [1025, 2048])

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in Microsoft.Extensions.Configuration.ConfigurationBinderBenchmarks

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
9.96 ms 11.07 ms 1.11 0.14 False
2.92 ms 3.27 ms 1.12 0.14 False
1.42 ms 1.49 ms 1.05 0.11 False
4.36 ms 4.83 ms 1.11 0.13 False
21.71 ms 23.61 ms 1.09 0.10 False
6.31 ms 6.77 ms 1.07 0.12 False
18.68 ms 20.26 ms 1.08 0.13 False

graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Microsoft.Extensions.Configuration.ConfigurationBinderBenchmarks*'

Payloads

Baseline
Compare

Microsoft.Extensions.Configuration.ConfigurationBinderBenchmarks.Get(ConfigurationProvidersCount: 16, KeysCountPerProvider: 20)

ETL Files

Histogram

JIT Disasms

Microsoft.Extensions.Configuration.ConfigurationBinderBenchmarks.Get(ConfigurationProvidersCount: 8, KeysCountPerProvider: 20)

ETL Files

Histogram

JIT Disasms

Microsoft.Extensions.Configuration.ConfigurationBinderBenchmarks.Get(ConfigurationProvidersCount: 8, KeysCountPerProvider: 10)

ETL Files

Histogram

JIT Disasms

Microsoft.Extensions.Configuration.ConfigurationBinderBenchmarks.Get(ConfigurationProvidersCount: 16, KeysCountPerProvider: 10)

ETL Files

Histogram

JIT Disasms

Microsoft.Extensions.Configuration.ConfigurationBinderBenchmarks.Get(ConfigurationProvidersCount: 16, KeysCountPerProvider: 40)

ETL Files

Histogram

JIT Disasms

Microsoft.Extensions.Configuration.ConfigurationBinderBenchmarks.Get(ConfigurationProvidersCount: 8, KeysCountPerProvider: 40)

ETL Files

Histogram

JIT Disasms

Microsoft.Extensions.Configuration.ConfigurationBinderBenchmarks.Get(ConfigurationProvidersCount: 32, KeysCountPerProvider: 10)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in StoreBlock.LocalAddress

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
12.87 ns 14.47 ns 1.12 0.40 False
12.86 ns 14.95 ns 1.16 0.43 False
5.90 ns 7.37 ns 1.25 0.07 False
6.47 ns 7.92 ns 1.22 0.27 False
5.46 ns 6.92 ns 1.27 0.19 False

graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'StoreBlock.LocalAddress*'

Payloads

Baseline
Compare

StoreBlock.LocalAddress.InitBlockAllZeros128

ETL Files

Histogram

JIT Disasms

StoreBlock.LocalAddress.InitBlockAllOnes128

ETL Files

Histogram

JIT Disasms

StoreBlock.LocalAddress.InitBlockAllOnes8

ETL Files

Histogram

JIT Disasms

StoreBlock.LocalAddress.InitBlockAllOnes32

ETL Files

Histogram

JIT Disasms

StoreBlock.LocalAddress.InitBlockAllOnes16

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Linq.Tests.Perf_OrderBy

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
1.43 ms 1.62 ms 1.14 0.13 False
1.02 ms 1.21 ms 1.20 0.16 False
693.46 μs 775.39 μs 1.12 0.22 False

graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Linq.Tests.Perf_OrderBy*'

Payloads

Baseline
Compare

System.Linq.Tests.Perf_OrderBy.OrderByValueType(NumberOfPeople: 512)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_OrderBy.OrderByCustomComparer(NumberOfPeople: 512)

ETL Files

Histogram

JIT Disasms

System.Linq.Tests.Perf_OrderBy.OrderByString(NumberOfPeople: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Copy link
Author

performanceautofiler bot commented Mar 5, 2024

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Tests.Perf_StringBuilder

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
118.18 ns 139.60 ns 1.18 0.18 False
51.75 μs 76.29 μs 1.47 0.08 True
669.20 μs 824.86 μs 1.23 0.32 False
397.68 μs 425.74 μs 1.07 0.16 False
52.22 μs 75.72 μs 1.45 0.09 True
1.07 μs 1.21 μs 1.13 0.19 False
49.85 μs 74.56 μs 1.50 0.10 True
948.53 ns 1.05 μs 1.11 0.21 False
684.19 ns 853.13 ns 1.25 0.37 False
1.17 μs 1.29 μs 1.10 0.18 False
66.64 ns 87.82 ns 1.32 0.50 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Tests.Perf_StringBuilder*'

Payloads

Baseline
Compare

System.Text.Tests.Perf_StringBuilder.ToString_MultipleSegments(length: 100)

ETL Files

Histogram

JIT Disasms

System.Text.Tests.Perf_StringBuilder.ToString_SingleSegment(length: 100000)

ETL Files

Histogram

JIT Disasms

System.Text.Tests.Perf_StringBuilder.Append_Char(length: 100000)

ETL Files

Histogram

JIT Disasms

System.Text.Tests.Perf_StringBuilder.Append_Strings(repeat: 1000)

ETL Files

Histogram

JIT Disasms

System.Text.Tests.Perf_StringBuilder.ToString_MultipleSegments(length: 100000)

ETL Files

Histogram

JIT Disasms

System.Text.Tests.Perf_StringBuilder.Append_Memory

ETL Files

Histogram

JIT Disasms

System.Text.Tests.Perf_StringBuilder.ctor_string(length: 100000)

ETL Files

Histogram

JIT Disasms

System.Text.Tests.Perf_StringBuilder.Append_NonEmptySpan

ETL Files

Histogram

JIT Disasms

System.Text.Tests.Perf_StringBuilder.Append_Char_Capacity(length: 100)

ETL Files

Histogram

JIT Disasms

System.Text.Tests.Perf_StringBuilder.Insert_Strings

ETL Files

Histogram

JIT Disasms

System.Text.Tests.Perf_StringBuilder.ctor_capacity(length: 100)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.TryGetValueFalse<Int32, Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
107.87 μs 121.41 μs 1.13 0.30 False
22.29 μs 27.75 μs 1.24 0.59 False
141.45 μs 156.43 μs 1.11 0.40 False
15.15 μs 19.27 μs 1.27 0.65 False

graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.TryGetValueFalse&lt;Int32, Int32&gt;*'

Payloads

Baseline
Compare

System.Collections.TryGetValueFalse<Int32, Int32>.ImmutableDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.TryGetValueFalse<Int32, Int32>.IDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.TryGetValueFalse<Int32, Int32>.ImmutableSortedDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.TryGetValueFalse<Int32, Int32>.Dictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.Tests.DictionarySequentialKeys

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
42.67 ns 48.71 ns 1.14 0.57 False
33.93 ns 45.49 ns 1.34 0.62 False
40.58 ns 47.59 ns 1.17 0.57 False
31.62 ns 41.50 ns 1.31 0.59 False
39.92 ns 46.85 ns 1.17 0.54 False
37.74 ns 46.08 ns 1.22 0.57 False
36.97 ns 48.21 ns 1.30 0.54 False
36.26 ns 41.84 ns 1.15 0.65 False
37.48 ns 43.59 ns 1.16 0.51 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Tests.DictionarySequentialKeys*'

Payloads

Baseline
Compare

System.Collections.Tests.DictionarySequentialKeys.TryGetValue_17_Int_32ByteValue

ETL Files

Histogram

JIT Disasms

System.Collections.Tests.DictionarySequentialKeys.TryGetValue_3k_Int_32ByteRefsValue

ETL Files

Histogram

JIT Disasms

System.Collections.Tests.DictionarySequentialKeys.TryGetValue_17_Int_32ByteRefsValue

ETL Files

Histogram

JIT Disasms

System.Collections.Tests.DictionarySequentialKeys.ContainsValue_3k_Int_Int

ETL Files

Histogram

JIT Disasms

System.Collections.Tests.DictionarySequentialKeys.ContainsKey_17_Int_32ByteValue

ETL Files

Histogram

JIT Disasms

System.Collections.Tests.DictionarySequentialKeys.TryGetValue_17_Int_Int

ETL Files

Histogram

JIT Disasms

System.Collections.Tests.DictionarySequentialKeys.ContainsValue_17_Int_Int

ETL Files

Histogram

JIT Disasms

System.Collections.Tests.DictionarySequentialKeys.TryGetValue_3k_Int_Int

ETL Files

Histogram

JIT Disasms

System.Collections.Tests.DictionarySequentialKeys.ContainsKey_17_Int_32ByteRefsValue

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Memory.Constructors<Byte>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
27.75 ns 39.60 ns 1.43 0.68 False
10.74 ns 15.11 ns 1.41 0.78 False
12.90 ns 17.52 ns 1.36 0.76 False
10.85 ns 16.22 ns 1.49 0.76 False
10.83 ns 14.63 ns 1.35 0.82 False

graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.Constructors&lt;Byte&gt;*'

Payloads

Baseline
Compare

System.Memory.Constructors<Byte>.SpanImplicitCastFromArraySegment

ETL Files

Histogram

JIT Disasms

System.Memory.Constructors<Byte>.ArrayAsMemory

ETL Files

Histogram

JIT Disasms

System.Memory.Constructors<Byte>.MemoryFromArrayStartLength

ETL Files

Histogram

JIT Disasms

System.Memory.Constructors<Byte>.ReadOnlyMemoryFromArray

ETL Files

Histogram

JIT Disasms

System.Memory.Constructors<Byte>.ReadOnlyMemoryFromArrayStartLength

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Copy link
Author

performanceautofiler bot commented Mar 5, 2024

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.ContainsTrue<String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
2.59 ms 4.09 ms 1.58 0.53 False
2.90 ms 3.31 ms 1.14 0.49 False
4.83 ms 5.78 ms 1.20 0.57 False
616.11 μs 690.43 μs 1.12 0.24 False
2.61 ms 3.30 ms 1.26 0.55 False
3.17 ms 3.79 ms 1.19 0.53 False
2.88 ms 3.33 ms 1.16 0.52 False
33.19 μs 46.87 μs 1.41 0.44 False
2.84 ms 3.38 ms 1.19 0.58 False
32.91 μs 40.54 μs 1.23 0.47 False
573.03 μs 646.39 μs 1.13 0.31 False
2.70 ms 3.69 ms 1.36 0.53 False
1.45 ms 2.03 ms 1.40 0.38 False
141.19 μs 153.55 μs 1.09 0.29 False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsTrue&lt;String&gt;*'

Payloads

Baseline
Compare

System.Collections.ContainsTrue<String>.ICollection(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsTrue<String>.LinkedList(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsTrue<String>.ImmutableList(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsTrue<String>.ImmutableSortedSet(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsTrue<String>.ImmutableArray(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsTrue<String>.Array(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsTrue<String>.Stack(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsTrue<String>.FrozenSet(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsTrue<String>.Queue(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsTrue<String>.HashSet(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsTrue<String>.SortedSet(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsTrue<String>.List(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsTrue<String>.Span(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsTrue<String>.ImmutableHashSet(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
62.33 ns 71.51 ns 1.15 0.67 False
14.17 ns 20.08 ns 1.42 0.75 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int32&gt;*'

Payloads

Baseline
Compare

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.GetHashCodeBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int32>.DivisionOperatorBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
35.77 ns 43.31 ns 1.21 0.75 False
45.56 ns 50.97 ns 1.12 0.48 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;SByte&gt;*'

Payloads

Baseline
Compare

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.SquareRootBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<SByte>.DivideBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in MicroBenchmarks.Serializers.Json_ToString<MyEventsListerViewModel>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
986.02 μs 1.06 ms 1.08 0.13 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'MicroBenchmarks.Serializers.Json_ToString&lt;MyEventsListerViewModel&gt;*'

Payloads

Baseline
Compare

MicroBenchmarks.Serializers.Json_ToString<MyEventsListerViewModel>.SystemTextJson_SourceGen_

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
42.41 ns 52.34 ns 1.23 0.65 False
57.36 ns 75.29 ns 1.31 0.62 False
12.20 ns 26.34 ns 2.16 0.79 False
12.98 ns 21.35 ns 1.65 0.77 False

graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt32&gt;*'

Payloads

Baseline
Compare

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.SquareRootBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.GetHashCodeBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.DivisionOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.DivideBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Copy link
Author

performanceautofiler bot commented Mar 5, 2024

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.Perf_DefaultFrozenDictionary

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
327.54 ns 389.61 ns 1.19 0.54 False
420.20 ns 546.52 ns 1.30 0.52 False
609.71 μs 735.41 μs 1.21 0.28 False
866.75 μs 960.21 μs 1.11 0.25 False
57.25 μs 64.62 μs 1.13 0.36 False
4.34 μs 5.39 μs 1.24 0.44 False
6.77 μs 8.30 μs 1.23 0.46 False

graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Perf_DefaultFrozenDictionary*'

Payloads

Baseline
Compare

System.Collections.Perf_DefaultFrozenDictionary.TryGetValue_False_FrozenDictionary(Count: 10)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_DefaultFrozenDictionary.TryGetValue_True_FrozenDictionary(Count: 10)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_DefaultFrozenDictionary.TryGetValue_False_FrozenDictionary(Count: 10000)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_DefaultFrozenDictionary.TryGetValue_True_FrozenDictionary(Count: 10000)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_DefaultFrozenDictionary.TryGetValue_False_FrozenDictionary(Count: 1000)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_DefaultFrozenDictionary.TryGetValue_False_FrozenDictionary(Count: 100)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_DefaultFrozenDictionary.TryGetValue_True_FrozenDictionary(Count: 100)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.Perf_Frozen<Int16>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
1.60 μs 1.83 μs 1.15 0.29 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Perf_Frozen&lt;Int16&gt;*'

Payloads

Baseline
Compare

System.Collections.Perf_Frozen<Int16>.TryGetValue_True(Count: 4)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.Tests.Perf_Dictionary

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
50.70 ms 71.51 ms 1.41 0.52 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Tests.Perf_Dictionary*'

Payloads

Baseline
Compare

System.Collections.Tests.Perf_Dictionary.ContainsValue(Items: 3000)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Serialization.Tests.WriteJson<Location>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
2.56 μs 2.85 μs 1.12 0.11 False
1.28 μs 1.49 μs 1.17 0.21 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson&lt;Location&gt;*'

Payloads

Baseline
Compare

System.Text.Json.Serialization.Tests.WriteJson<Location>.SerializeObjectProperty(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.WriteJson<Location>.SerializeToWriter(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Buffers.Text.Tests.Utf8FormatterTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
162.62 ns 197.45 ns 1.21 0.30 False
31.83 ns 36.37 ns 1.14 0.75 False
362.08 ns 405.56 ns 1.12 0.09 False
26.23 ns 37.43 ns 1.43 0.76 False
239.37 ns 269.96 ns 1.13 0.21 False
22.99 ns 30.30 ns 1.32 0.73 False

graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Text.Tests.Utf8FormatterTests*'

Payloads

Baseline
Compare

System.Buffers.Text.Tests.Utf8FormatterTests.FormatterDecimal(value: 123456.789)

ETL Files

Histogram

JIT Disasms

System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt32(value: 2147483647)

ETL Files

Histogram

JIT Disasms

System.Buffers.Text.Tests.Utf8FormatterTests.FormatterDouble(value: 1.7976931348623157E+308)

ETL Files

Histogram

JIT Disasms

System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt32(value: 12345)

ETL Files

Histogram

JIT Disasms

System.Buffers.Text.Tests.Utf8FormatterTests.FormatterDouble(value: 12345)

ETL Files

Histogram

JIT Disasms

System.Buffers.Text.Tests.Utf8FormatterTests.FormatterInt32(value: 4)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Serialization.Tests.WriteJson<ClassRecord>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
1.84 μs 2.03 μs 1.10 0.22 False
711.26 ns 800.51 ns 1.13 0.27 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson&lt;ClassRecord&gt;*'

Payloads

Baseline
Compare

System.Text.Json.Serialization.Tests.WriteJson<ClassRecord>.SerializeObjectProperty(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.WriteJson<ClassRecord>.SerializeToWriter(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.CreateAddAndRemove<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
201.01 μs 229.33 μs 1.14 0.23 False
1.59 ms 1.73 ms 1.09 0.15 False
8.74 μs 10.06 μs 1.15 0.33 False
32.22 μs 38.62 μs 1.20 0.51 False
11.06 μs 12.74 μs 1.15 0.32 False
50.35 μs 62.61 μs 1.24 0.21 False

graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CreateAddAndRemove&lt;Int32&gt;*'

Payloads

Baseline
Compare

System.Collections.CreateAddAndRemove<Int32>.SortedSet(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.CreateAddAndRemove<Int32>.SortedDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.CreateAddAndRemove<Int32>.Stack(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.CreateAddAndRemove<Int32>.LinkedList(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.CreateAddAndRemove<Int32>.Queue(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.CreateAddAndRemove<Int32>.Dictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Copy link
Author

performanceautofiler bot commented Mar 5, 2024

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_UInt64

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
37.10 ns 49.93 ns 1.35 0.67 False
45.69 ns 53.85 ns 1.18 0.67 False
36.88 ns 44.53 ns 1.21 0.71 False
45.65 ns 61.26 ns 1.34 0.69 False
61.35 ns 72.04 ns 1.17 0.54 False
61.59 ns 74.10 ns 1.20 0.55 False

graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_UInt64*'

Payloads

Baseline
Compare

System.Tests.Perf_UInt64.TryParseHex(value: "0")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_UInt64.ParseSpan(value: "0")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_UInt64.TryParseHex(value: "3039")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_UInt64.ParseSpan(value: "12345")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_UInt64.TryParseHex(value: "FFFFFFFFFFFFFFFF")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_UInt64.ParseSpan(value: "18446744073709551615")

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Document.Tests.Perf_EnumerateArray

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
8.05 μs 8.76 μs 1.09 0.38 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Document.Tests.Perf_EnumerateArray*'

Payloads

Baseline
Compare

System.Text.Json.Document.Tests.Perf_EnumerateArray.EnumerateArray(TestCase: ArrayOfStrings)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in Devirtualization.Boxing

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
21.84 ns 30.99 ns 1.42 0.69 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Devirtualization.Boxing*'

Payloads

Baseline
Compare

Devirtualization.Boxing.InterfaceTypeCheckAndCall

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.TryGetValueFalse<String, String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
30.05 μs 32.90 μs 1.10 0.40 False
672.40 μs 754.15 μs 1.12 0.17 False
1.22 ms 1.43 ms 1.17 0.19 False
23.56 μs 29.24 μs 1.24 0.53 False
32.05 μs 38.26 μs 1.19 0.43 False
30.15 μs 34.95 μs 1.16 0.48 False
118.64 μs 137.04 μs 1.16 0.27 False

graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.TryGetValueFalse&lt;String, String&gt;*'

Payloads

Baseline
Compare

System.Collections.TryGetValueFalse<String, String>.FrozenDictionaryOptimized(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.TryGetValueFalse<String, String>.SortedList(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.TryGetValueFalse<String, String>.SortedDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.TryGetValueFalse<String, String>.ConcurrentDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.TryGetValueFalse<String, String>.IDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.TryGetValueFalse<String, String>.Dictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.TryGetValueFalse<String, String>.ImmutableDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in Devirtualization.EqualityComparer

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
353.49 ns 401.77 ns 1.14 0.19 False
339.01 ns 405.00 ns 1.19 0.20 False
345.88 ns 424.27 ns 1.23 0.25 False
333.79 ns 401.76 ns 1.20 0.21 False

graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Devirtualization.EqualityComparer*'

Payloads

Baseline
Compare

Devirtualization.EqualityComparer.ValueTupleCompareNoOpt

ETL Files

Histogram

JIT Disasms

Devirtualization.EqualityComparer.ValueTupleCompare

ETL Files

Histogram

JIT Disasms

Devirtualization.EqualityComparer.ValueTupleCompareWrapped

ETL Files

Histogram

JIT Disasms

Devirtualization.EqualityComparer.ValueTupleCompareCached

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in MicroBenchmarks.Serializers.Xml_ToStream<MyEventsListerViewModel>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
3.37 ms 3.68 ms 1.09 0.13 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'MicroBenchmarks.Serializers.Xml_ToStream&lt;MyEventsListerViewModel&gt;*'

Payloads

Baseline
Compare

MicroBenchmarks.Serializers.Xml_ToStream<MyEventsListerViewModel>.DataContractSerializer_

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_Environment

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
1.32 μs 1.69 μs 1.28 0.49 False
134.21 ns 145.33 ns 1.08 0.34 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Environment*'

Payloads

Baseline
Compare

System.Tests.Perf_Environment.GetEnvironmentVariables

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Environment.GetEnvironmentVariable

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.IO.Hashing.Tests.Crc64_AppendPerf

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
53.07 ns 67.56 ns 1.27 0.59 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.IO.Hashing.Tests.Crc64_AppendPerf*'

Payloads

Baseline
Compare

System.IO.Hashing.Tests.Crc64_AppendPerf.Append(BufferSize: 16)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Buffers.Tests.NonStandardArrayPoolTests<Byte>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
39.74 ns 48.23 ns 1.21 0.55 False
80.21 ns 91.44 ns 1.14 0.44 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Tests.NonStandardArrayPoolTests&lt;Byte&gt;*'

Payloads

Baseline
Compare

System.Buffers.Tests.NonStandardArrayPoolTests<Byte>.RentNoReturn(RentalSize: 64, UseSharedPool: True)

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.NonStandardArrayPoolTests<Byte>.RentNoReturn(RentalSize: 64, UseSharedPool: False)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Copy link
Author

performanceautofiler bot commented Mar 5, 2024

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.TryGetValueTrue<String, String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
37.35 μs 46.51 μs 1.25 0.37 False
1.02 ms 1.26 ms 1.24 0.18 False
648.43 μs 690.36 μs 1.06 0.23 False
37.14 μs 45.79 μs 1.23 0.38 False
517.23 μs 611.64 μs 1.18 0.26 False
43.53 μs 49.71 μs 1.14 0.53 False
149.26 μs 176.44 μs 1.18 0.31 False
34.09 μs 43.07 μs 1.26 0.48 False

graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.TryGetValueTrue&lt;String, String&gt;*'

Payloads

Baseline
Compare

System.Collections.TryGetValueTrue<String, String>.Dictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.TryGetValueTrue<String, String>.SortedDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.TryGetValueTrue<String, String>.ImmutableSortedDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.TryGetValueTrue<String, String>.FrozenDictionaryOptimized(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.TryGetValueTrue<String, String>.SortedList(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.TryGetValueTrue<String, String>.IDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.TryGetValueTrue<String, String>.ImmutableDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.TryGetValueTrue<String, String>.ConcurrentDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.CtorGivenSize<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
193.38 ns 209.32 ns 1.08 0.07 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CtorGivenSize&lt;Int32&gt;*'

Payloads

Baseline
Compare

System.Collections.CtorGivenSize<Int32>.List(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in Microsoft.Extensions.Configuration.Xml.XmlConfigurationProviderBenchmarks

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
413.51 μs 462.84 μs 1.12 0.13 False
145.56 μs 156.45 μs 1.07 0.12 False
154.77 μs 168.92 μs 1.09 0.03 False
324.04 μs 340.83 μs 1.05 0.11 False

graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Microsoft.Extensions.Configuration.Xml.XmlConfigurationProviderBenchmarks*'

Payloads

Baseline
Compare

Microsoft.Extensions.Configuration.Xml.XmlConfigurationProviderBenchmarks.Load(FileName: "names.xml")

ETL Files

Histogram

JIT Disasms

Microsoft.Extensions.Configuration.Xml.XmlConfigurationProviderBenchmarks.Load(FileName: "simple.xml")

ETL Files

Histogram

JIT Disasms

Microsoft.Extensions.Configuration.Xml.XmlConfigurationProviderBenchmarks.Load(FileName: "deep.xml")

ETL Files

Histogram

JIT Disasms

Microsoft.Extensions.Configuration.Xml.XmlConfigurationProviderBenchmarks.Load(FileName: "repeated.xml")

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Buffers.Tests.NonStandardArrayPoolTests<Object>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
51.88 ns 62.32 ns 1.20 0.44 False
93.68 ns 104.60 ns 1.12 0.39 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Tests.NonStandardArrayPoolTests&lt;Object&gt;*'

Payloads

Baseline
Compare

System.Buffers.Tests.NonStandardArrayPoolTests<Object>.RentNoReturn(RentalSize: 64, UseSharedPool: True)

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.NonStandardArrayPoolTests<Object>.RentNoReturn(RentalSize: 64, UseSharedPool: False)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.CopyTo<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
102.11 ns 1.15 μs 11.26 0.37 True
96.75 ns 1.15 μs 11.91 0.41 True
126.93 ns 1.17 μs 9.26 0.44 True

graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CopyTo&lt;Int32&gt;*'

Payloads

Baseline
Compare

System.Collections.CopyTo<Int32>.Span(Size: 2048)

ETL Files

Histogram

JIT Disasms

System.Collections.CopyTo<Int32>.ReadOnlySpan(Size: 2048)

ETL Files

Histogram

JIT Disasms

System.Collections.CopyTo<Int32>.Memory(Size: 2048)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
31.64 ns 42.15 ns 1.33 0.65 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Byte&gt;*'

Payloads

Baseline
Compare

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Byte>.SquareRootBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in Microsoft.Extensions.DependencyInjection.GetServiceIEnumerable

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
642.51 ns 747.60 ns 1.16 0.23 False
130.97 ns 158.55 ns 1.21 0.51 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Microsoft.Extensions.DependencyInjection.GetServiceIEnumerable*'

Payloads

Baseline
Compare

Microsoft.Extensions.DependencyInjection.GetServiceIEnumerable.Scoped

ETL Files

Histogram

JIT Disasms

Microsoft.Extensions.DependencyInjection.GetServiceIEnumerable.Singleton

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in MicroBenchmarks.Serializers.Xml_ToStream<XmlElement>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
660.54 ns 753.71 ns 1.14 0.29 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'MicroBenchmarks.Serializers.Xml_ToStream&lt;XmlElement&gt;*'

Payloads

Baseline
Compare

MicroBenchmarks.Serializers.Xml_ToStream<XmlElement>.DataContractSerializer_BinaryXml_

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Copy link
Author

performanceautofiler bot commented Mar 5, 2024

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.Tests.Perf_PriorityQueue<String, String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
17.94 μs 20.48 μs 1.14 0.27 False
2.71 ms 3.10 ms 1.14 0.22 False
187.20 μs 218.62 μs 1.17 0.35 False
3.11 μs 3.62 μs 1.16 0.26 False
5.77 ms 6.75 ms 1.17 0.24 False
26.49 μs 28.90 μs 1.09 0.24 False
158.12 μs 184.36 μs 1.17 0.28 False
402.24 μs 441.20 μs 1.10 0.28 False

graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Tests.Perf_PriorityQueue&lt;String, String&gt;*'

Payloads

Baseline
Compare

System.Collections.Tests.Perf_PriorityQueue<String, String>.Dequeue_And_Enqueue(Size: 10)

ETL Files

Histogram

JIT Disasms

System.Collections.Tests.Perf_PriorityQueue<String, String>.HeapSort(Size: 1000)

ETL Files

Histogram

JIT Disasms

System.Collections.Tests.Perf_PriorityQueue<String, String>.K_Max_Elements(Size: 1000)

ETL Files

Histogram

JIT Disasms

System.Collections.Tests.Perf_PriorityQueue<String, String>.K_Max_Elements(Size: 10)

ETL Files

Histogram

JIT Disasms

System.Collections.Tests.Perf_PriorityQueue<String, String>.Dequeue_And_Enqueue(Size: 1000)

ETL Files

Histogram

JIT Disasms

System.Collections.Tests.Perf_PriorityQueue<String, String>.K_Max_Elements(Size: 100)

ETL Files

Histogram

JIT Disasms

System.Collections.Tests.Perf_PriorityQueue<String, String>.HeapSort(Size: 100)

ETL Files

Histogram

JIT Disasms

System.Collections.Tests.Perf_PriorityQueue<String, String>.Dequeue_And_Enqueue(Size: 100)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Threading.Tests.Perf_Lock

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
65.25 ns 74.29 ns 1.14 0.57 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Threading.Tests.Perf_Lock*'

Payloads

Baseline
Compare

System.Threading.Tests.Perf_Lock.ReaderWriterLockSlimPerf

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.IterateForEachNonGeneric<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
26.99 μs 31.21 μs 1.16 0.40 False
25.21 μs 28.42 μs 1.13 0.38 False
11.98 μs 15.27 μs 1.28 0.34 False
13.80 μs 17.61 μs 1.28 0.44 False
14.39 μs 18.74 μs 1.30 0.40 False

graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.IterateForEachNonGeneric&lt;Int32&gt;*'

Payloads

Baseline
Compare

System.Collections.IterateForEachNonGeneric<Int32>.Hashtable(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.IterateForEachNonGeneric<Int32>.SortedList(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.IterateForEachNonGeneric<Int32>.Stack(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.IterateForEachNonGeneric<Int32>.ArrayList(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.IterateForEachNonGeneric<Int32>.Queue(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_Random

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
35.79 ns 43.15 ns 1.21 0.65 False
26.51 ns 31.41 ns 1.18 0.61 False
20.81 ns 26.97 ns 1.30 0.65 False
24.53 ns 33.26 ns 1.36 0.63 False
101.67 ns 109.84 ns 1.08 0.49 False
27.20 ns 38.73 ns 1.42 0.68 False

graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Random*'

Payloads

Baseline
Compare

System.Tests.Perf_Random.Next_int

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Random.Next_int_int

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Random.Next_int_int_unseeded

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Random.NextSingle

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Random.Next_long_long

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Random.Next_int_unseeded

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.IO.Tests.StringReaderReadLineTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
294.79 μs 409.04 μs 1.39 0.57 False
6.73 μs 9.85 μs 1.46 0.02 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.IO.Tests.StringReaderReadLineTests*'

Payloads

Baseline
Compare

System.IO.Tests.StringReaderReadLineTests.ReadLine(LineLengthRange: [ 0, 0])

ETL Files

Histogram

JIT Disasms

System.IO.Tests.StringReaderReadLineTests.ReadLine(LineLengthRange: [1025, 2048])

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Net.Primitives.Tests.IPAddressPerformanceTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
41.04 ns 53.73 ns 1.31 0.69 False
14.14 ns 16.69 ns 1.18 0.62 False
21.77 ns 30.52 ns 1.40 0.71 False

graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Net.Primitives.Tests.IPAddressPerformanceTests*'

Payloads

Baseline
Compare

System.Net.Primitives.Tests.IPAddressPerformanceTests.TryFormat(address: 143.24.20.36)

ETL Files

Histogram

JIT Disasms

System.Net.Primitives.Tests.IPAddressPerformanceTests.TryWriteBytes(address: 143.24.20.36)

ETL Files

Histogram

JIT Disasms

System.Net.Primitives.Tests.IPAddressPerformanceTests.TryWriteBytes(address: 1020:3040:5060:7080:9010:1112:1314:1516)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Copy link
Author

performanceautofiler bot commented Mar 5, 2024

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_UInt16

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
44.37 ns 54.67 ns 1.23 0.53 False
55.04 ns 60.04 ns 1.09 0.57 False
35.47 ns 42.18 ns 1.19 0.58 False
43.73 ns 53.76 ns 1.23 0.59 False

graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_UInt16*'

Payloads

Baseline
Compare

System.Tests.Perf_UInt16.TryParse(value: "12345")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_UInt16.Parse(value: "0")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_UInt16.TryParse(value: "0")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_UInt16.TryParse(value: "65535")

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Serialization.Tests.ReadJson<TreeRecord>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
77.33 μs 85.09 μs 1.10 0.17 False
76.36 μs 85.76 μs 1.12 0.15 False
92.29 μs 102.39 μs 1.11 0.17 False

graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.ReadJson&lt;TreeRecord&gt;*'

Payloads

Baseline
Compare

System.Text.Json.Serialization.Tests.ReadJson<TreeRecord>.DeserializeFromString(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.ReadJson<TreeRecord>.DeserializeFromUtf8Bytes(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.ReadJson<TreeRecord>.DeserializeFromReader(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Reflection.Invoke

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
241.66 ns 286.54 ns 1.19 0.26 False
295.24 ns 364.53 ns 1.23 0.23 False
382.74 ns 415.82 ns 1.09 0.22 False
417.36 ns 491.15 ns 1.18 0.23 False
260.84 ns 341.62 ns 1.31 0.27 False

graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Reflection.Invoke*'

Payloads

Baseline
Compare

System.Reflection.Invoke.StaticMethod4_int_string_struct_class

ETL Files

Histogram

JIT Disasms

System.Reflection.Invoke.StaticMethod4_arrayNotCached_int_string_struct_class

ETL Files

Histogram

JIT Disasms

System.Reflection.Invoke.Ctor0_ActivatorCreateInstance_NoParams

ETL Files

Histogram

JIT Disasms

System.Reflection.Invoke.Property_Set_class

ETL Files

Histogram

JIT Disasms

System.Reflection.Invoke.Ctor4_int_string_struct_class

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in MicroBenchmarks.Serializers.Xml_FromStream<Location>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
20.50 μs 21.82 μs 1.06 0.05 False
9.12 μs 9.91 μs 1.09 0.19 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'MicroBenchmarks.Serializers.Xml_FromStream&lt;Location&gt;*'

Payloads

Baseline
Compare

MicroBenchmarks.Serializers.Xml_FromStream<Location>.DataContractSerializer_

ETL Files

Histogram

JIT Disasms

MicroBenchmarks.Serializers.Xml_FromStream<Location>.DataContractSerializer_BinaryXml_

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.IterateForNonGeneric<String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
5.49 μs 6.76 μs 1.23 0.25 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.IterateForNonGeneric&lt;String&gt;*'

Payloads

Baseline
Compare

System.Collections.IterateForNonGeneric<String>.ArrayList(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in Microsoft.Extensions.Logging.ScopesOverheadBenchmark

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
189.94 ns 228.91 ns 1.21 0.31 False
141.70 ns 171.53 ns 1.21 0.42 False
144.51 ns 178.77 ns 1.24 0.38 False
206.68 ns 251.18 ns 1.22 0.29 False
142.74 ns 166.21 ns 1.16 0.34 False
137.22 ns 164.20 ns 1.20 0.44 False
382.96 ns 467.08 ns 1.22 0.23 False
200.85 ns 219.87 ns 1.09 0.36 False

graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Microsoft.Extensions.Logging.ScopesOverheadBenchmark*'

Payloads

Baseline
Compare

Microsoft.Extensions.Logging.ScopesOverheadBenchmark.FilteredByLevel_InsideScope(HasISupportLoggingScopeLogger: True, CaptureScopes: False)

ETL Files

Histogram

JIT Disasms

Microsoft.Extensions.Logging.ScopesOverheadBenchmark.FilteredByLevel(HasISupportLoggingScopeLogger: False, CaptureScopes: False)

ETL Files

Histogram

JIT Disasms

Microsoft.Extensions.Logging.ScopesOverheadBenchmark.FilteredByLevel(HasISupportLoggingScopeLogger: True, CaptureScopes: True)

ETL Files

Histogram

JIT Disasms

Microsoft.Extensions.Logging.ScopesOverheadBenchmark.FilteredByLevel_InsideScope(HasISupportLoggingScopeLogger: False, CaptureScopes: True)

ETL Files

Histogram

JIT Disasms

Microsoft.Extensions.Logging.ScopesOverheadBenchmark.FilteredByLevel(HasISupportLoggingScopeLogger: False, CaptureScopes: True)

ETL Files

Histogram

JIT Disasms

Microsoft.Extensions.Logging.ScopesOverheadBenchmark.FilteredByLevel(HasISupportLoggingScopeLogger: True, CaptureScopes: False)

ETL Files

Histogram

JIT Disasms

Microsoft.Extensions.Logging.ScopesOverheadBenchmark.FilteredByLevel_InsideScope(HasISupportLoggingScopeLogger: True, CaptureScopes: True)

ETL Files

Histogram

JIT Disasms

Microsoft.Extensions.Logging.ScopesOverheadBenchmark.FilteredByLevel_InsideScope(HasISupportLoggingScopeLogger: False, CaptureScopes: False)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Copy link
Author

performanceautofiler bot commented Mar 5, 2024

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Serialization.Tests.ReadJson<ImmutableSortedDictionary<String, String>>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
364.44 μs 410.96 μs 1.13 0.16 False
361.15 μs 396.96 μs 1.10 0.13 False
370.54 μs 411.98 μs 1.11 0.13 False
353.91 μs 417.09 μs 1.18 0.16 False
359.47 μs 398.71 μs 1.11 0.11 False
364.39 μs 409.97 μs 1.13 0.16 False

graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.ReadJson&lt;ImmutableSortedDictionary&lt;String, String&gt;&gt;*'

Payloads

Baseline
Compare

System.Text.Json.Serialization.Tests.ReadJson<ImmutableSortedDictionary<String, String>>.DeserializeFromString(Mode: Reflection)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.ReadJson<ImmutableSortedDictionary<String, String>>.DeserializeFromString(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.ReadJson<ImmutableSortedDictionary<String, String>>.DeserializeFromReader(Mode: Reflection)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.ReadJson<ImmutableSortedDictionary<String, String>>.DeserializeFromUtf8Bytes(Mode: Reflection)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.ReadJson<ImmutableSortedDictionary<String, String>>.DeserializeFromUtf8Bytes(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.ReadJson<ImmutableSortedDictionary<String, String>>.DeserializeFromReader(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in XmlDocumentTests.XmlNodeTests.Perf_XmlNode

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
7.50 ns 12.08 ns 1.61 0.83 False
20.30 ns 35.93 ns 1.77 0.72 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'XmlDocumentTests.XmlNodeTests.Perf_XmlNode*'

Payloads

Baseline
Compare

XmlDocumentTests.XmlNodeTests.Perf_XmlNode.GetValue

ETL Files

Histogram

JIT Disasms

XmlDocumentTests.XmlNodeTests.Perf_XmlNode.GetAttributes

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Serialization.Tests.WriteJson<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
1.14 μs 1.28 μs 1.12 0.28 False
252.81 ns 300.59 ns 1.19 0.35 False
454.47 ns 572.25 ns 1.26 0.33 False
579.65 ns 676.52 ns 1.17 0.30 False
570.83 ns 689.27 ns 1.21 0.27 False
463.32 ns 547.55 ns 1.18 0.32 False
248.90 ns 322.17 ns 1.29 0.38 False

graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson&lt;Int32&gt;*'

Payloads

Baseline
Compare

System.Text.Json.Serialization.Tests.WriteJson<Int32>.SerializeObjectProperty(Mode: Reflection)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.WriteJson<Int32>.SerializeToWriter(Mode: Reflection)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.WriteJson<Int32>.SerializeToUtf8Bytes(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.WriteJson<Int32>.SerializeToString(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.WriteJson<Int32>.SerializeToString(Mode: Reflection)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.WriteJson<Int32>.SerializeToUtf8Bytes(Mode: Reflection)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.WriteJson<Int32>.SerializeToWriter(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_Matrix3x2

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
22.84 ns 29.11 ns 1.27 0.66 False
8.72 ns 10.42 ns 1.19 0.78 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_Matrix3x2*'

Payloads

Baseline
Compare

System.Numerics.Tests.Perf_Matrix3x2.MultiplyByMatrixOperatorBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_Matrix3x2.NegateBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in Microsoft.Extensions.DependencyInjection.ActivatorUtilitiesBenchmark

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
345.43 ns 399.30 ns 1.16 0.25 False
355.91 ns 408.01 ns 1.15 0.22 False
541.14 ns 670.67 ns 1.24 0.29 False
227.46 ns 274.10 ns 1.21 0.29 False
1.01 μs 1.08 μs 1.07 0.14 False

graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Microsoft.Extensions.DependencyInjection.ActivatorUtilitiesBenchmark*'

Payloads

Baseline
Compare

Microsoft.Extensions.DependencyInjection.ActivatorUtilitiesBenchmark.Factory_1Injected_2Explicit_OutOfOrder

ETL Files

Histogram

JIT Disasms

Microsoft.Extensions.DependencyInjection.ActivatorUtilitiesBenchmark.Factory_1Injected_2Explicit

ETL Files

Histogram

JIT Disasms

Microsoft.Extensions.DependencyInjection.ActivatorUtilitiesBenchmark.Factory_3Injected

ETL Files

Histogram

JIT Disasms

Microsoft.Extensions.DependencyInjection.ActivatorUtilitiesBenchmark.Factory_3Explicit

ETL Files

Histogram

JIT Disasms

Microsoft.Extensions.DependencyInjection.ActivatorUtilitiesBenchmark.GetService_0Injected

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in MicroBenchmarks.Serializers.Json_ToStream<CollectionsOfPrimitives>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
683.03 μs 720.91 μs 1.06 0.15 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'MicroBenchmarks.Serializers.Json_ToStream&lt;CollectionsOfPrimitives&gt;*'

Payloads

Baseline
Compare

MicroBenchmarks.Serializers.Json_ToStream<CollectionsOfPrimitives>.SystemTextJson_SourceGen_

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.IO.Tests.Perf_Directory

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
219.27 ns 252.66 ns 1.15 0.28 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.IO.Tests.Perf_Directory*'

Payloads

Baseline
Compare

System.IO.Tests.Perf_Directory.GetCurrentDirectory

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Memory.ReadOnlyMemory<Byte>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
160.90 ns 199.13 ns 1.24 0.44 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.ReadOnlyMemory&lt;Byte&gt;*'

Payloads

Baseline
Compare

System.Memory.ReadOnlyMemory<Byte>.Pin(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Copy link
Author

performanceautofiler bot commented Mar 5, 2024

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.IndexerSetReverse<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
3.29 μs 3.94 μs 1.20 0.39 False
5.86 μs 7.68 μs 1.31 0.44 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.IndexerSetReverse&lt;Int32&gt;*'

Payloads

Baseline
Compare

System.Collections.IndexerSetReverse<Int32>.List(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.IndexerSetReverse<Int32>.IList(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Memory.Slice<Byte>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
3.83 ns 5.30 ns 1.38 0.40 False
7.79 ns 9.40 ns 1.21 0.11 False
6.13 ns 7.40 ns 1.21 0.32 False

graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.Slice&lt;Byte&gt;*'

Payloads

Baseline
Compare

System.Memory.Slice<Byte>.ReadOnlySpanStartLength

ETL Files

Histogram

JIT Disasms

System.Memory.Slice<Byte>.MemoryStart

ETL Files

Histogram

JIT Disasms

System.Memory.Slice<Byte>.MemorySpanStart

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Xml.Tests.Perf_XmlConvert

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
271.92 ns 300.47 ns 1.11 0.23 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Xml.Tests.Perf_XmlConvert*'

Payloads

Baseline
Compare

System.Xml.Tests.Perf_XmlConvert.TimeSpan_ToString

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in MicroBenchmarks.Serializers.Xml_ToStream<IndexViewModel>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
177.82 μs 195.32 μs 1.10 0.16 False
240.77 μs 267.90 μs 1.11 0.12 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'MicroBenchmarks.Serializers.Xml_ToStream&lt;IndexViewModel&gt;*'

Payloads

Baseline
Compare

MicroBenchmarks.Serializers.Xml_ToStream<IndexViewModel>.DataContractSerializer_BinaryXml_

ETL Files

Histogram

JIT Disasms

MicroBenchmarks.Serializers.Xml_ToStream<IndexViewModel>.DataContractSerializer_

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Buffers.Tests.SearchValuesByteTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
94.79 ns 105.30 ns 1.11 0.33 False
55.45 ns 73.47 ns 1.32 0.53 False
60.29 ns 68.35 ns 1.13 0.56 False
93.66 ns 108.49 ns 1.16 0.35 False

graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Tests.SearchValuesByteTests*'

Payloads

Baseline
Compare

System.Buffers.Tests.SearchValuesByteTests.ContainsAny(Values: "abcdefABCDEF0123456789")

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.SearchValuesByteTests.IndexOfAny(Values: "abcdefABCDEF0123456789Ü")

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.SearchValuesByteTests.IndexOfAnyExcept(Values: "abcdefABCDEF0123456789Ü")

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.SearchValuesByteTests.IndexOfAny(Values: "abcdefABCDEF0123456789")

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Constructor

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
4.42 ns 6.97 ns 1.58 0.75 False
5.41 ns 7.86 ns 1.45 0.76 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Constructor*'

Payloads

Baseline
Compare

System.Numerics.Tests.Constructor.ConstructorBenchmark_Double

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Constructor.ConstructorBenchmark_Single

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.ContainsKeyFalse<Int32, Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
109.54 μs 121.90 μs 1.11 0.29 False
12.47 μs 13.96 μs 1.12 0.65 False
135.26 μs 158.31 μs 1.17 0.41 False
11.63 μs 13.02 μs 1.12 0.57 False
15.10 μs 20.95 μs 1.39 0.66 False

graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsKeyFalse&lt;Int32, Int32&gt;*'

Payloads

Baseline
Compare

System.Collections.ContainsKeyFalse<Int32, Int32>.ImmutableDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsKeyFalse<Int32, Int32>.FrozenDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsKeyFalse<Int32, Int32>.ImmutableSortedDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsKeyFalse<Int32, Int32>.ConcurrentDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsKeyFalse<Int32, Int32>.Dictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
101.72 ns 115.30 ns 1.13 0.59 False
20.33 ns 34.81 ns 1.71 0.79 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Int16&gt;*'

Payloads

Baseline
Compare

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.GetHashCodeBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Int16>.SquareRootBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Copy link
Author

performanceautofiler bot commented Mar 5, 2024

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.Tests.Add_Remove_SteadyState<String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
38.27 ns 55.18 ns 1.44 0.65 False
43.16 ns 59.09 ns 1.37 0.64 False
38.12 ns 53.31 ns 1.40 0.66 False
125.09 ns 156.52 ns 1.25 0.51 False
32.11 ns 44.72 ns 1.39 0.63 False

graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Tests.Add_Remove_SteadyState&lt;String&gt;*'

Payloads

Baseline
Compare

System.Collections.Tests.Add_Remove_SteadyState<String>.ConcurrentQueue(Count: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.Tests.Add_Remove_SteadyState<String>.Queue(Count: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.Tests.Add_Remove_SteadyState<String>.Stack(Count: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.Tests.Add_Remove_SteadyState<String>.ConcurrentBag(Count: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.Tests.Add_Remove_SteadyState<String>.ConcurrentStack(Count: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.IterateForEachNonGeneric<String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
14.33 μs 19.07 μs 1.33 0.44 False
22.74 μs 30.14 μs 1.33 0.40 False
14.17 μs 17.15 μs 1.21 0.40 False
12.07 μs 17.29 μs 1.43 0.35 False
26.01 μs 31.44 μs 1.21 0.41 False

graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.IterateForEachNonGeneric&lt;String&gt;*'

Payloads

Baseline
Compare

System.Collections.IterateForEachNonGeneric<String>.Queue(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.IterateForEachNonGeneric<String>.SortedList(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.IterateForEachNonGeneric<String>.ArrayList(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.IterateForEachNonGeneric<String>.Stack(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.IterateForEachNonGeneric<String>.Hashtable(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.AddGivenSize<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
19.91 μs 23.05 μs 1.16 0.41 False
6.96 μs 9.38 μs 1.35 0.42 False
67.22 μs 83.96 μs 1.25 0.33 False
23.73 μs 30.68 μs 1.29 0.37 False

graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.AddGivenSize&lt;Int32&gt;*'

Payloads

Baseline
Compare

System.Collections.AddGivenSize<Int32>.Dictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.AddGivenSize<Int32>.ICollection(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.AddGivenSize<Int32>.ObservableCollection(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.AddGivenSize<Int32>.IDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.IndexerSet<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
23.08 μs 27.18 μs 1.18 0.47 False
5.54 μs 6.50 μs 1.17 0.37 False
10.60 μs 14.72 μs 1.39 0.48 False

graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.IndexerSet&lt;Int32&gt;*'

Payloads

Baseline
Compare

System.Collections.IndexerSet<Int32>.Dictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.IndexerSet<Int32>.List(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.IndexerSet<Int32>.IList(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.Sort<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
779.02 μs 929.84 μs 1.19 0.22 False
71.42 μs 86.73 μs 1.21 0.31 False
72.61 μs 84.76 μs 1.17 0.30 False

graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Sort&lt;Int32&gt;*'

Payloads

Baseline
Compare

System.Collections.Sort<Int32>.LinqQuery(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.Sort<Int32>.Array_ComparerClass(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.Sort<Int32>.Array_ComparerStruct(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Int

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
0.09 ns 1.82 ns 19.30 0.95 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Int*'

Payloads

Baseline
Compare

System.Runtime.Intrinsics.Tests.Perf_Vector128Int.InequalityOperatorBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.Perf_Frozen<NotKnownComparable>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
595.53 ns 659.24 ns 1.11 0.17 False
1.12 μs 1.23 μs 1.10 0.24 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Perf_Frozen&lt;NotKnownComparable&gt;*'

Payloads

Baseline
Compare

System.Collections.Perf_Frozen<NotKnownComparable>.ToFrozenDictionary(Count: 4)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_Frozen<NotKnownComparable>.ToFrozenSet(Count: 4)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Serialization.Tests.WriteJson<StructRecord>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
955.62 ns 1.07 μs 1.11 0.23 False
714.17 ns 820.36 ns 1.15 0.26 False
1.13 μs 1.31 μs 1.16 0.19 False

graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson&lt;StructRecord&gt;*'

Payloads

Baseline
Compare

System.Text.Json.Serialization.Tests.WriteJson<StructRecord>.SerializeToUtf8Bytes(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.WriteJson<StructRecord>.SerializeToWriter(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.WriteJson<StructRecord>.SerializeToString(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Copy link
Author

performanceautofiler bot commented Mar 5, 2024

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Serialization.Tests.WriteJson<LargeStructWithProperties>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
1.32 μs 1.55 μs 1.17 0.24 False
1.43 μs 1.57 μs 1.09 0.19 False
3.20 μs 3.55 μs 1.11 0.13 False

graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson&lt;LargeStructWithProperties&gt;*'

Payloads

Baseline
Compare

System.Text.Json.Serialization.Tests.WriteJson<LargeStructWithProperties>.SerializeToUtf8Bytes(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.WriteJson<LargeStructWithProperties>.SerializeToString(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.WriteJson<LargeStructWithProperties>.SerializeObjectProperty(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.TryAddDefaultSize<String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
51.03 μs 56.69 μs 1.11 0.13 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.TryAddDefaultSize&lt;String&gt;*'

Payloads

Baseline
Compare

System.Collections.TryAddDefaultSize<String>.Dictionary(Count: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Memory.MemoryMarshal<Byte>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
5.67 ns 6.69 ns 1.18 0.42 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.MemoryMarshal&lt;Byte&gt;*'

Payloads

Baseline
Compare

System.Memory.MemoryMarshal<Byte>.Read

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_Boolean

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
29.25 ns 35.66 ns 1.22 0.64 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Boolean*'

Payloads

Baseline
Compare

System.Tests.Perf_Boolean.Parse(value: "TRUE")

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.IO.Hashing.Tests.Crc32_AppendPerf

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
51.27 ns 59.25 ns 1.16 0.60 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.IO.Hashing.Tests.Crc32_AppendPerf*'

Payloads

Baseline
Compare

System.IO.Hashing.Tests.Crc32_AppendPerf.Append(BufferSize: 16)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Serialization.Tests.ReadJson<Dictionary<String, String>>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
62.26 μs 74.81 μs 1.20 0.15 False
74.86 μs 86.61 μs 1.16 0.15 False
75.79 μs 85.36 μs 1.13 0.13 False
62.80 μs 68.61 μs 1.09 0.15 False
64.76 μs 68.31 μs 1.05 0.13 False

graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.ReadJson&lt;Dictionary&lt;String, String&gt;&gt;*'

Payloads

Baseline
Compare

System.Text.Json.Serialization.Tests.ReadJson<Dictionary<String, String>>.DeserializeFromString(Mode: Reflection)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.ReadJson<Dictionary<String, String>>.DeserializeFromReader(Mode: Reflection)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.ReadJson<Dictionary<String, String>>.DeserializeFromReader(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.ReadJson<Dictionary<String, String>>.DeserializeFromUtf8Bytes(Mode: Reflection)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.ReadJson<Dictionary<String, String>>.DeserializeFromString(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in XmlDocumentTests.XmlDocumentTests.Perf_XmlDocument

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
585.85 ns 631.90 ns 1.08 0.27 False
40.91 ns 53.94 ns 1.32 0.71 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'XmlDocumentTests.XmlDocumentTests.Perf_XmlDocument*'

Payloads

Baseline
Compare

XmlDocumentTests.XmlDocumentTests.Perf_XmlDocument.Create

ETL Files

Histogram

JIT Disasms

XmlDocumentTests.XmlDocumentTests.Perf_XmlDocument.GetDocumentElement

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in MicroBenchmarks.Serializers.Xml_FromStream<MyEventsListerViewModel>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
3.93 ms 4.36 ms 1.11 0.17 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'MicroBenchmarks.Serializers.Xml_FromStream&lt;MyEventsListerViewModel&gt;*'

Payloads

Baseline
Compare

MicroBenchmarks.Serializers.Xml_FromStream<MyEventsListerViewModel>.DataContractSerializer_BinaryXml_

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in MicroBenchmarks.Serializers.Xml_FromStream<LoginViewModel>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
4.28 μs 4.69 μs 1.10 0.22 False
10.32 μs 11.45 μs 1.11 0.10 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'MicroBenchmarks.Serializers.Xml_FromStream&lt;LoginViewModel&gt;*'

Payloads

Baseline
Compare

MicroBenchmarks.Serializers.Xml_FromStream<LoginViewModel>.DataContractSerializer_BinaryXml_

ETL Files

Histogram

JIT Disasms

MicroBenchmarks.Serializers.Xml_FromStream<LoginViewModel>.DataContractSerializer_

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.Concurrent.IsEmpty<String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
76.89 ns 88.44 ns 1.15 0.41 False
44.79 ns 52.51 ns 1.17 0.60 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Concurrent.IsEmpty&lt;String&gt;*'

Payloads

Baseline
Compare

System.Collections.Concurrent.IsEmpty<String>.Dictionary(Size: 0)

ETL Files

Histogram

JIT Disasms

System.Collections.Concurrent.IsEmpty<String>.Bag(Size: 0)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in PerfLabTests.DelegatePerf

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
2.31 ms 2.85 ms 1.23 0.41 False
11.78 ms 15.48 ms 1.31 0.36 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'PerfLabTests.DelegatePerf*'

Payloads

Baseline
Compare

PerfLabTests.DelegatePerf.DelegateInvoke

ETL Files

Histogram

JIT Disasms

PerfLabTests.DelegatePerf.MulticastDelegateInvoke(length: 100)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Copy link
Author

performanceautofiler bot commented Mar 5, 2024

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.IO.Tests.StringReaderReadToEndTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
95.97 ns 100.97 ns 1.05 0.42 False
91.66 ns 100.36 ns 1.10 0.39 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.IO.Tests.StringReaderReadToEndTests*'

Payloads

Baseline
Compare

System.IO.Tests.StringReaderReadToEndTests.ReadToEnd(LineLengthRange: [1025, 2048])

ETL Files

Histogram

JIT Disasms

System.IO.Tests.StringReaderReadToEndTests.ReadToEnd(LineLengthRange: [ 0, 0])

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Serialization.Tests.WriteJson<SimpleStructWithProperties>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
633.06 ns 765.84 ns 1.21 0.27 False
767.14 ns 891.54 ns 1.16 0.27 False
433.37 ns 493.85 ns 1.14 0.28 False

graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson&lt;SimpleStructWithProperties&gt;*'

Payloads

Baseline
Compare

System.Text.Json.Serialization.Tests.WriteJson<SimpleStructWithProperties>.SerializeToUtf8Bytes(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.WriteJson<SimpleStructWithProperties>.SerializeToString(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.WriteJson<SimpleStructWithProperties>.SerializeToWriter(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in Microsoft.Extensions.Logging.LoggingOverhead

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
373.51 ns 446.57 ns 1.20 0.21 False
429.41 ns 470.08 ns 1.09 0.25 False
35.73 ns 49.80 ns 1.39 0.68 False
147.67 ns 165.60 ns 1.12 0.43 False
351.92 ns 429.46 ns 1.22 0.22 False

graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Microsoft.Extensions.Logging.LoggingOverhead*'

Payloads

Baseline
Compare

Microsoft.Extensions.Logging.LoggingOverhead.TwoArguments_FilteredByLevel

ETL Files

Histogram

JIT Disasms

Microsoft.Extensions.Logging.LoggingOverhead.NoArguments_DefineMessage

ETL Files

Histogram

JIT Disasms

Microsoft.Extensions.Logging.LoggingOverhead.NoArguments_DefineMessage_FilteredByLevel

ETL Files

Histogram

JIT Disasms

Microsoft.Extensions.Logging.LoggingOverhead.TwoArguments_DefineMessage_FilteredByLevel

ETL Files

Histogram

JIT Disasms

Microsoft.Extensions.Logging.LoggingOverhead.NoArguments

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in MicroBenchmarks.Serializers.Xml_FromStream<CollectionsOfPrimitives>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
3.03 ms 3.61 ms 1.19 0.19 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'MicroBenchmarks.Serializers.Xml_FromStream&lt;CollectionsOfPrimitives&gt;*'

Payloads

Baseline
Compare

MicroBenchmarks.Serializers.Xml_FromStream<CollectionsOfPrimitives>.DataContractSerializer_BinaryXml_

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_Single

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
185.51 ns 222.31 ns 1.20 0.28 False
211.99 ns 234.19 ns 1.10 0.30 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Single*'

Payloads

Baseline
Compare

System.Tests.Perf_Single.TryParse(value: "3.4028235E+38")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Single.Parse(value: "3.4028235E+38")

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
104.31 ns 125.89 ns 1.21 0.56 False
40.20 ns 48.23 ns 1.20 0.63 False
17.81 ns 25.12 ns 1.41 0.72 False

graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;UInt16&gt;*'

Payloads

Baseline
Compare

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.GetHashCodeBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.SquareRootBenchmark

ETL Files

Histogram

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt16>.DivideBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Buffers.Tests.SearchValuesCharTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
244.87 ns 267.83 ns 1.09 0.02 False
106.99 ns 112.85 ns 1.05 0.29 False
98.63 ns 107.26 ns 1.09 0.33 False
94.68 ns 108.85 ns 1.15 0.37 False
7.74 ns 12.82 ns 1.66 0.73 False
12.13 ns 15.53 ns 1.28 0.73 False
97.24 ns 104.22 ns 1.07 0.37 False

graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Tests.SearchValuesCharTests*'

Payloads

Baseline
Compare

System.Buffers.Tests.SearchValuesCharTests.IndexOfAnyExcept(Values: "ßäöüÄÖÜ")

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.SearchValuesCharTests.ContainsAny(Values: "abcdefABCDEF0123456789")

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.SearchValuesCharTests.LastIndexOfAny(Values: "abcdefABCDEF0123456789")

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.SearchValuesCharTests.LastIndexOfAnyExcept(Values: "abcdefABCDEF0123456789Ü")

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.SearchValuesCharTests.Contains(Values: "ßäöüÄÖÜ")

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.SearchValuesCharTests.Contains(Values: "abcdefABCDEF0123456789Ü")

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.SearchValuesCharTests.LastIndexOfAnyExcept(Values: "abcdefABCDEF0123456789")

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Float

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
57.55 ns 74.11 ns 1.29 0.61 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Float*'

Payloads

Baseline
Compare

System.Runtime.Intrinsics.Tests.Perf_Vector128Float.GetHashCodeBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Copy link
Author

performanceautofiler bot commented Mar 5, 2024

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in MicroBenchmarks.Serializers.Json_FromString<IndexViewModel>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
100.66 μs 113.69 μs 1.13 0.09 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'MicroBenchmarks.Serializers.Json_FromString&lt;IndexViewModel&gt;*'

Payloads

Baseline
Compare

MicroBenchmarks.Serializers.Json_FromString<IndexViewModel>.SystemTextJson_SourceGen_

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_Vector4

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
25.64 ns 29.59 ns 1.15 0.72 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_Vector4*'

Payloads

Baseline
Compare

System.Numerics.Tests.Perf_Vector4.GetHashCodeBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
65.93 ns 78.69 ns 1.19 0.64 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;*'

Payloads

Baseline
Compare

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.GetHashCodeBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Cache

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
130.67 ms 141.52 ms 1.08 0.15 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Cache*'

Payloads

Baseline
Compare

System.Text.RegularExpressions.Tests.Perf_Regex_Cache.IsMatch(total: 400000, unique: 7, cacheSize: 15)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.IO.Tests.StreamReaderReadLineTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
665.79 μs 753.92 μs 1.13 0.17 False
16.56 μs 17.64 μs 1.07 0.03 False
464.27 μs 536.99 μs 1.16 0.48 False

graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.IO.Tests.StreamReaderReadLineTests*'

Payloads

Baseline
Compare

System.IO.Tests.StreamReaderReadLineTests.ReadLine(LineLengthRange: [ 1, 1])

ETL Files

Histogram

JIT Disasms

System.IO.Tests.StreamReaderReadLineTests.ReadLine(LineLengthRange: [1025, 2048])

ETL Files

Histogram

JIT Disasms

System.IO.Tests.StreamReaderReadLineTests.ReadLine(LineLengthRange: [ 0, 0])

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Threading.Tests.Perf_Interlocked

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
7.98 ns 16.43 ns 2.06 0.87 False
6.64 ns 11.01 ns 1.66 0.83 False
8.74 ns 12.52 ns 1.43 0.85 False

graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Threading.Tests.Perf_Interlocked*'

Payloads

Baseline
Compare

System.Threading.Tests.Perf_Interlocked.Increment_long

ETL Files

Histogram

JIT Disasms

System.Threading.Tests.Perf_Interlocked.CompareExchange_long

ETL Files

Histogram

JIT Disasms

System.Threading.Tests.Perf_Interlocked.Exchange_long

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_Decimal

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
17.35 ns 23.24 ns 1.34 0.68 False
21.26 ns 24.28 ns 1.14 0.71 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Decimal*'

Payloads

Baseline
Compare

System.Tests.Perf_Decimal.Subtract

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Decimal.Multiply

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in MicroBenchmarks.Serializers.Json_FromString<Location>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
4.80 μs 5.26 μs 1.09 0.20 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'MicroBenchmarks.Serializers.Json_FromString&lt;Location&gt;*'

Payloads

Baseline
Compare

MicroBenchmarks.Serializers.Json_FromString<Location>.SystemTextJson_SourceGen_

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in Microsoft.Extensions.Logging.EventSourceLogger

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
927.10 ns 1.04 μs 1.13 0.23 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Microsoft.Extensions.Logging.EventSourceLogger*'

Payloads

Baseline
Compare

Microsoft.Extensions.Logging.EventSourceLogger.NestedScopes_TwoMessages(HasSubscribers: False, Json: True)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in Benchmark.GetChildKeysTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
1.14 ms 1.27 ms 1.11 0.16 False
1.14 ms 1.26 ms 1.11 0.17 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Benchmark.GetChildKeysTests*'

Payloads

Baseline
Compare

Benchmark.GetChildKeysTests.AddChainedConfigurationWithCommonPaths

ETL Files

Histogram

JIT Disasms

Benchmark.GetChildKeysTests.AddChainedConfigurationWithSplitting

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Serialization.Tests.WriteJson<TreeRecord>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
49.83 μs 56.77 μs 1.14 0.13 False
48.96 μs 55.50 μs 1.13 0.15 False
47.03 μs 52.06 μs 1.11 0.19 False

graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson&lt;TreeRecord&gt;*'

Payloads

Baseline
Compare

System.Text.Json.Serialization.Tests.WriteJson<TreeRecord>.SerializeToString(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.WriteJson<TreeRecord>.SerializeObjectProperty(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Serialization.Tests.WriteJson<TreeRecord>.SerializeToWriter(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Reader.Tests.Perf_Base64

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
353.82 ns 386.47 ns 1.09 0.08 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Reader.Tests.Perf_Base64*'

Payloads

Baseline
Compare

System.Text.Json.Reader.Tests.Perf_Base64.ReadBase64EncodedByteArray_HeavyEscaping(NumberOfBytes: 100)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Copy link
Author

performanceautofiler bot commented Mar 5, 2024

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in MicroBenchmarks.Serializers.Xml_ToStream<ClassImplementingIXmlSerialiable>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
1.20 μs 1.41 μs 1.18 0.26 False
1.75 μs 2.06 μs 1.18 0.25 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'MicroBenchmarks.Serializers.Xml_ToStream&lt;ClassImplementingIXmlSerialiable&gt;*'

Payloads

Baseline
Compare

MicroBenchmarks.Serializers.Xml_ToStream<ClassImplementingIXmlSerialiable>.DataContractSerializer_BinaryXml_

ETL Files

Histogram

JIT Disasms

MicroBenchmarks.Serializers.Xml_ToStream<ClassImplementingIXmlSerialiable>.DataContractSerializer_

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in PerfLabTests.BlockCopyPerf

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
38.57 ns 46.34 ns 1.20 0.59 False
48.12 ns 59.13 ns 1.23 0.61 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'PerfLabTests.BlockCopyPerf*'

Payloads

Baseline
Compare

PerfLabTests.BlockCopyPerf.CallBlockCopy(numElements: 10)

ETL Files

Histogram

JIT Disasms

PerfLabTests.BlockCopyPerf.CallBlockCopy(numElements: 100)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Perf_Convert

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
12.91 ns 23.56 ns 1.82 0.71 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Perf_Convert*'

Payloads

Baseline
Compare

System.Perf_Convert.GetTypeCode

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_DateTime

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
9.94 ns 25.49 ns 2.56 0.75 False
386.20 ns 434.01 ns 1.12 0.22 False
5.59 ns 7.70 ns 1.38 0.80 False

graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_DateTime*'

Payloads

Baseline
Compare

System.Tests.Perf_DateTime.ObjectEquals

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_DateTime.ToString(format: null)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_DateTime.Year

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.IO.Tests.BinaryWriterExtendedTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
57.26 ns 76.59 ns 1.34 0.62 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.IO.Tests.BinaryWriterExtendedTests*'

Payloads

Baseline
Compare

System.IO.Tests.BinaryWriterExtendedTests.WriteAsciiString(StringLengthInChars: 32)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_VectorOf<SByte>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
179.96 ns 216.48 ns 1.20 0.48 False
17.68 ns 22.54 ns 1.27 0.74 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;SByte&gt;*'

Payloads

Baseline
Compare

System.Numerics.Tests.Perf_VectorOf<SByte>.GetHashCodeBenchmark

ETL Files

Histogram

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<SByte>.MultiplyOperatorBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in StoreBlock.AnyLocation

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
13.68 ns 15.55 ns 1.14 0.27 False
6.47 ns 7.49 ns 1.16 0.07 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'StoreBlock.AnyLocation*'

Payloads

Baseline
Compare

StoreBlock.AnyLocation.InitBlockAllZeros128

ETL Files

Histogram

JIT Disasms

StoreBlock.AnyLocation.InitBlockAllOnes16

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in MicroBenchmarks.Serializers.Xml_ToStream<CollectionsOfPrimitives>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
2.51 ms 2.88 ms 1.15 0.16 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'MicroBenchmarks.Serializers.Xml_ToStream&lt;CollectionsOfPrimitives&gt;*'

Payloads

Baseline
Compare

MicroBenchmarks.Serializers.Xml_ToStream<CollectionsOfPrimitives>.DataContractSerializer_

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_Type

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
9.51 ns 12.05 ns 1.27 0.70 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Type*'

Payloads

Baseline
Compare

System.Tests.Perf_Type.op_Equality

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in Microsoft.Extensions.Primitives.StringSegmentBenchmark

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
21.31 ns 24.24 ns 1.14 0.76 False
19.71 ns 26.84 ns 1.36 0.74 False
23.81 ns 26.91 ns 1.13 0.59 False
19.42 ns 28.16 ns 1.45 0.78 False
52.19 ns 70.12 ns 1.34 0.64 False
73.76 ns 89.54 ns 1.21 0.32 False

graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Microsoft.Extensions.Primitives.StringSegmentBenchmark*'

Payloads

Baseline
Compare

Microsoft.Extensions.Primitives.StringSegmentBenchmark.Ctor_String

ETL Files

Histogram

JIT Disasms

Microsoft.Extensions.Primitives.StringSegmentBenchmark.GetValue

ETL Files

Histogram

JIT Disasms

Microsoft.Extensions.Primitives.StringSegmentBenchmark.StartsWith

ETL Files

Histogram

JIT Disasms

Microsoft.Extensions.Primitives.StringSegmentBenchmark.IndexOfAny

ETL Files

Histogram

JIT Disasms

Microsoft.Extensions.Primitives.StringSegmentBenchmark.TrimStart

ETL Files

Histogram

JIT Disasms

Microsoft.Extensions.Primitives.StringSegmentBenchmark.Indexer

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 512bcaf1b198a7234fad4d1791c558f698b1eb15
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in MicroBenchmarks.Serializers.Json_FromStream<IndexViewModel>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
101.85 μs 116.93 μs 1.15 0.09 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'MicroBenchmarks.Serializers.Json_FromStream&lt;IndexViewModel&gt;*'

Payloads

Baseline
Compare

MicroBenchmarks.Serializers.Json_FromStream<IndexViewModel>.SystemTextJson_SourceGen_

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Copy link
Author

performanceautofiler bot commented Mar 5, 2024

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Threading.Channels.Tests.UnboundedChannelPerfTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
306.72 ns 355.44 ns 1.16 0.34 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Threading.Channels.Tests.UnboundedChannelPerfTests*'

Payloads

Baseline
Compare

System.Threading.Channels.Tests.UnboundedChannelPerfTests.TryWriteThenTryRead

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in PerfLabTests.DictionaryExpansion

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
583.41 ns 680.43 ns 1.17 0.21 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'PerfLabTests.DictionaryExpansion*'

Payloads

Baseline
Compare

PerfLabTests.DictionaryExpansion.ExpandDictionaries

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in PerfLabTests.EnumPerf

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
41.52 ns 53.19 ns 1.28 0.54 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'PerfLabTests.EnumPerf*'

Payloads

Baseline
Compare

PerfLabTests.EnumPerf.EnumEquals

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.ContainsTrueComparer<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
675.47 μs 786.33 μs 1.16 0.26 False
573.32 μs 647.64 μs 1.13 0.39 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsTrueComparer&lt;Int32&gt;*'

Payloads

Baseline
Compare

System.Collections.ContainsTrueComparer<Int32>.ImmutableSortedSet(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.ContainsTrueComparer<Int32>.SortedSet(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.TryGetValueTrue<Int32, Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
123.67 μs 136.68 μs 1.11 0.24 False
414.92 μs 471.76 μs 1.14 0.25 False
13.75 μs 19.95 μs 1.45 0.58 False
114.30 μs 136.04 μs 1.19 0.40 False

graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.TryGetValueTrue&lt;Int32, Int32&gt;*'

Payloads

Baseline
Compare

System.Collections.TryGetValueTrue<Int32, Int32>.ImmutableDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.TryGetValueTrue<Int32, Int32>.SortedDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.TryGetValueTrue<Int32, Int32>.ConcurrentDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.TryGetValueTrue<Int32, Int32>.ImmutableSortedDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Serialization.Tests.ReadJson<Hashtable>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
121.99 μs 132.71 μs 1.09 0.17 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.ReadJson&lt;Hashtable&gt;*'

Payloads

Baseline
Compare

System.Text.Json.Serialization.Tests.ReadJson<Hashtable>.DeserializeFromReader(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in MicroBenchmarks.Serializers.Json_ToStream<Location>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
1.48 μs 1.80 μs 1.22 0.12 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'MicroBenchmarks.Serializers.Json_ToStream&lt;Location&gt;*'

Payloads

Baseline
Compare

MicroBenchmarks.Serializers.Json_ToStream<Location>.SystemTextJson_SourceGen_

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.Tests.Perf_SortedSet

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
36.53 μs 40.54 μs 1.11 0.18 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Tests.Perf_SortedSet*'

Payloads

Baseline
Compare

System.Collections.Tests.Perf_SortedSet.EnumerateViewBetween

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_Guid

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
0.00 ns 2.58 ns 0.89 False
17.92 ns 24.72 ns 1.38 0.79 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Guid*'

Payloads

Baseline
Compare

System.Tests.Perf_Guid.EqualsOperator

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Guid.ctor_bytes

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in MicroBenchmarks.Serializers.Json_FromStream<Location>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
4.62 μs 5.12 μs 1.11 0.13 False
37.44 μs 41.48 μs 1.11 0.16 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'MicroBenchmarks.Serializers.Json_FromStream&lt;Location&gt;*'

Payloads

Baseline
Compare

MicroBenchmarks.Serializers.Json_FromStream<Location>.SystemTextJson_SourceGen_

ETL Files

Histogram

JIT Disasms

MicroBenchmarks.Serializers.Json_FromStream<Location>.DataContractJsonSerializer_

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_VectorOf<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
64.14 ns 70.65 ns 1.10 0.56 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;Int32&gt;*'

Payloads

Baseline
Compare

System.Numerics.Tests.Perf_VectorOf<Int32>.GetHashCodeBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Serialization.Tests.WriteJson<IndexViewModel>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
35.83 μs 39.94 μs 1.11 0.03 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.WriteJson&lt;IndexViewModel&gt;*'

Payloads

Baseline
Compare

System.Text.Json.Serialization.Tests.WriteJson<IndexViewModel>.SerializeToUtf8Bytes(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.InteropServices.Tests.SafeHandleTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
27.16 ns 32.51 ns 1.20 0.54 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.InteropServices.Tests.SafeHandleTests*'

Payloads

Baseline
Compare

System.Runtime.InteropServices.Tests.SafeHandleTests.AddRef_GetHandle_Release

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Copy link
Author

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in MicroBenchmarks.Serializers.Json_ToString<LoginViewModel>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
851.02 ns 928.34 ns 1.09 0.17 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'MicroBenchmarks.Serializers.Json_ToString&lt;LoginViewModel&gt;*'

Payloads

Baseline
Compare

MicroBenchmarks.Serializers.Json_ToString<LoginViewModel>.SystemTextJson_SourceGen_

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in MicroBenchmarks.Serializers.Json_ToString<CollectionsOfPrimitives>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
480.63 μs 538.33 μs 1.12 0.17 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'MicroBenchmarks.Serializers.Json_ToString&lt;CollectionsOfPrimitives&gt;*'

Payloads

Baseline
Compare

MicroBenchmarks.Serializers.Json_ToString<CollectionsOfPrimitives>.SystemTextJson_SourceGen_

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Buffers.Binary.Tests.BinaryReadAndWriteTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
104.10 ns 112.28 ns 1.08 0.41 False
83.21 ns 117.53 ns 1.41 0.42 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Binary.Tests.BinaryReadAndWriteTests*'

Payloads

Baseline
Compare

System.Buffers.Binary.Tests.BinaryReadAndWriteTests.ReadStructFieldByFieldUsingBitConverterBE

ETL Files

Histogram

JIT Disasms

System.Buffers.Binary.Tests.BinaryReadAndWriteTests.ReadStructFieldByFieldUsingBitConverterLE

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.Sort<IntStruct>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
1.42 ms 1.59 ms 1.12 0.13 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Sort&lt;IntStruct&gt;*'

Payloads

Baseline
Compare

System.Collections.Sort<IntStruct>.LinqQuery(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_Vector3

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
21.49 ns 24.12 ns 1.12 0.72 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_Vector3*'

Payloads

Baseline
Compare

System.Numerics.Tests.Perf_Vector3.GetHashCodeBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in V8.Crypto.Support

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
18.97 ms 21.86 ms 1.15 0.30 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'V8.Crypto.Support*'

Payloads

Baseline
Compare

V8.Crypto.Support.Bench

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_Quaternion

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
15.00 ns 21.43 ns 1.43 0.69 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_Quaternion*'

Payloads

Baseline
Compare

System.Numerics.Tests.Perf_Quaternion.SlerpBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in MicroBenchmarks.Serializers.Json_ToStream<LoginViewModel>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
3.50 μs 3.84 μs 1.10 0.14 False
706.99 ns 772.44 ns 1.09 0.21 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'MicroBenchmarks.Serializers.Json_ToStream&lt;LoginViewModel&gt;*'

Payloads

Baseline
Compare

MicroBenchmarks.Serializers.Json_ToStream<LoginViewModel>.DataContractJsonSerializer_

ETL Files

Histogram

JIT Disasms

MicroBenchmarks.Serializers.Json_ToStream<LoginViewModel>.SystemTextJson_SourceGen_

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_VectorOf<Double>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
32.86 ns 52.65 ns 1.60 0.72 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;Double&gt;*'

Payloads

Baseline
Compare

System.Numerics.Tests.Perf_VectorOf<Double>.GetHashCodeBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_DateTimeOffset

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
386.52 ns 413.79 ns 1.07 0.19 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_DateTimeOffset*'

Payloads

Baseline
Compare

System.Tests.Perf_DateTimeOffset.ToString(format: "G")

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.IterateForNonGeneric<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
5.51 μs 6.52 μs 1.18 0.33 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.IterateForNonGeneric&lt;Int32&gt;*'

Payloads

Baseline
Compare

System.Collections.IterateForNonGeneric<Int32>.ArrayList(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in MicroBenchmarks.Serializers.Xml_FromStream<XmlElement>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
2.22 μs 2.43 μs 1.09 0.22 False
6.99 μs 7.68 μs 1.10 0.27 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'MicroBenchmarks.Serializers.Xml_FromStream&lt;XmlElement&gt;*'

Payloads

Baseline
Compare

MicroBenchmarks.Serializers.Xml_FromStream<XmlElement>.DataContractSerializer_BinaryXml_

ETL Files

Histogram

JIT Disasms

MicroBenchmarks.Serializers.Xml_FromStream<XmlElement>.DataContractSerializer_

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_VectorOf<UInt32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
62.31 ns 71.06 ns 1.14 0.64 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;UInt32&gt;*'

Payloads

Baseline
Compare

System.Numerics.Tests.Perf_VectorOf<UInt32>.GetHashCodeBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.IO.Tests.Perf_StreamWriter

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
172.95 ns 203.50 ns 1.18 0.33 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.IO.Tests.Perf_StreamWriter*'

Payloads

Baseline
Compare

System.IO.Tests.Perf_StreamWriter.WriteFormat

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Serialization.Tests.ReadJson<LoginViewModel>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
2.83 μs 3.19 μs 1.12 0.19 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.ReadJson&lt;LoginViewModel&gt;*'

Payloads

Baseline
Compare

System.Text.Json.Serialization.Tests.ReadJson<LoginViewModel>.DeserializeFromReader(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Copy link
Author

performanceautofiler bot commented Mar 5, 2024

Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in Microsoft.Extensions.DependencyInjection.TimeToFirstService

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
4.71 μs 5.43 μs 1.15 0.20 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Microsoft.Extensions.DependencyInjection.TimeToFirstService*'

Payloads

Baseline
Compare

Microsoft.Extensions.DependencyInjection.TimeToFirstService.BuildProvider(Mode: "Default")

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_Double

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
244.47 ns 272.59 ns 1.12 0.21 False
234.28 ns 254.14 ns 1.08 0.23 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Double*'

Payloads

Baseline
Compare

System.Tests.Perf_Double.Parse(value: "1.7976931348623157e+308")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Double.TryParse(value: "-1.7976931348623157e+308")

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in MicroBenchmarks.Serializers.Xml_ToStream<Location>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
4.45 μs 5.03 μs 1.13 0.26 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'MicroBenchmarks.Serializers.Xml_ToStream&lt;Location&gt;*'

Payloads

Baseline
Compare

MicroBenchmarks.Serializers.Xml_ToStream<Location>.DataContractSerializer_BinaryXml_

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Serialization.Tests.ReadJson<IndexViewModel>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
122.17 μs 133.02 μs 1.09 0.10 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Serialization.Tests.ReadJson&lt;IndexViewModel&gt;*'

Payloads

Baseline
Compare

System.Text.Json.Serialization.Tests.ReadJson<IndexViewModel>.DeserializeFromReader(Mode: SourceGen)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Threading.Tests.Perf_Thread

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
11.16 ns 17.21 ns 1.54 0.76 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Threading.Tests.Perf_Thread*'

Payloads

Baseline
Compare

System.Threading.Tests.Perf_Thread.CurrentThread

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in BenchmarksGame.PiDigits_3

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
837.32 ms 1.05 secs 1.26 0.00 True

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'BenchmarksGame.PiDigits_3*'

Payloads

Baseline
Compare

BenchmarksGame.PiDigits_3.RunBench(n: 3000, expected: "8649423196\t:3000")

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.Concurrent.Count<String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
70.60 ns 87.04 ns 1.23 0.50 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Concurrent.Count&lt;String&gt;*'

Payloads

Baseline
Compare

System.Collections.Concurrent.Count<String>.Queue_EnqueueCountDequeue(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 512bcaf1b198a7234fad4d1791c558f698b1eb15
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in XmlDocumentTests.XmlNodeListTests.Perf_XmlNodeList

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
758.61 ns 973.62 ns 1.28 0.40 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'XmlDocumentTests.XmlNodeListTests.Perf_XmlNodeList*'

Payloads

Baseline
Compare

XmlDocumentTests.XmlNodeListTests.Perf_XmlNodeList.Enumerator

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Tests.Perf_Guids

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
4.99 ms 5.58 ms 1.12 0.10 False
4.87 ms 5.25 ms 1.08 0.13 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Tests.Perf_Guids*'

Payloads

Baseline
Compare

System.Text.Json.Tests.Perf_Guids.WriteGuids(Formatted: False, SkipValidation: False)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Tests.Perf_Guids.WriteGuids(Formatted: False, SkipValidation: True)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.IndexerSetReverse<String>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
9.73 μs 13.42 μs 1.38 0.50 False
3.01 μs 3.58 μs 1.19 0.37 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.IndexerSetReverse&lt;String&gt;*'

Payloads

Baseline
Compare

System.Collections.IndexerSetReverse<String>.IList(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.IndexerSetReverse<String>.Array(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Threading.Channels.Tests.SpscUnboundedChannelPerfTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
398.55 ns 441.91 ns 1.11 0.24 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Threading.Channels.Tests.SpscUnboundedChannelPerfTests*'

Payloads

Baseline
Compare

System.Threading.Channels.Tests.SpscUnboundedChannelPerfTests.TryWriteThenTryRead

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.Concurrent.Count<Int32>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
98.30 ns 112.85 ns 1.15 0.47 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Concurrent.Count&lt;Int32&gt;*'

Payloads

Baseline
Compare

System.Collections.Concurrent.Count<Int32>.Bag(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.IO.Tests.UnmanagedMemoryStreamTests

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
262.51 μs 280.14 μs 1.07 0.23 True

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.IO.Tests.UnmanagedMemoryStreamTests*'

Payloads

Baseline
Compare

System.IO.Tests.UnmanagedMemoryStreamTests.ReadAsBytes

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture x64
OS ubuntu 22.04
Queue TigerUbuntu
Baseline 339443b0408f45503380558aa2cf2a9ecc2cbaa9
Compare 70bb372b45a15eb1b6a81ad8444e0d60d8521b4b
Diff Diff
Configs AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tests.Perf_VectorOf<Byte>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio
185.90 ns 219.50 ns 1.18 0.48 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;Byte&gt;*'

Payloads

Baseline
Compare

System.Numerics.Tests.Perf_VectorOf<Byte>.GetHashCodeBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

@radekdoulik
Copy link
Member

the range is dotnet/runtime@a79c62d...2ab51c6

@radekdoulik
Copy link
Member

in our measurements I see regression falling into this range
image

where we have more narrow range dotnet/runtime@fc08df1...4acd106

looks like it could be dotnet/runtime#98230
(it regressed later again in the range dotnet/runtime@5c57621...2756c94 which contains dotnet/runtime#98515)

@vargaz please take a look

@vargaz
Copy link

vargaz commented Mar 7, 2024

I can't reproduce these locally using small test apps. 339443b0408f45503380558aa2cf2a9ecc2cbaa9 and 5ade1eeede3b7cefd460351fa589a3f668334a8e seems to have about the same perf.

@lewing
Copy link
Member

lewing commented Mar 7, 2024

#30686 was filed as well

@lewing
Copy link
Member

lewing commented Apr 25, 2024

Tracking the work in dotnet/runtime#99161

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants