Microsoft.Extensions.Configuration.Binder.Tests.ConfigurationBinderTests.BindCanReadStaticProperty failing intermittently

[jkoritzinsky]

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=280353
Build error leg or test failing: Microsoft.Extensions.Configuration.Binder.Tests.ConfigurationBinderTests.BindCanReadStaticProperty
Pull request: #86519

Error Message

Fill the error message using known issues guidance.

{
  "ErrorMessage": "Expected: other stuff",
  "BuildRetry": false,
  "ErrorPattern": "",
  "ExcludeConsoleLog": true
}

Report

Build	Definition	Test	Pull Request
436679	dotnet/runtime	Microsoft.Extensions.Configuration.Binder.Tests.ConfigurationBinderTests.BindCanReadStaticProperty
431376	dotnet/runtime	Microsoft.Extensions.Configuration.Binder.Tests.ConfigurationBinderTests.BindCanReadStaticProperty
430806	dotnet/runtime	Microsoft.Extensions.Configuration.Binder.Tests.ConfigurationBinderTests.BindCanReadStaticProperty	#93066
429943	dotnet/runtime	Microsoft.Extensions.Configuration.Binder.Tests.ConfigurationBinderTests.BindCanReadStaticProperty	#92057
425385	dotnet/runtime	Microsoft.Extensions.Configuration.Binder.Tests.ConfigurationBinderTests.BindCanReadStaticProperty
418980	dotnet/runtime	Microsoft.Extensions.Configuration.Binder.Tests.ConfigurationBinderTests.BindCanReadStaticProperty
417649	dotnet/runtime	Microsoft.Extensions.Configuration.Binder.Tests.ConfigurationBinderTests.BindCanReadStaticProperty

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
0	0	7

Known issue validation

Build: 🔎
Result validation: ⚠️ Validation could not be done without an Azure DevOps build URL on the issue. Please add it to the "Build: 🔎" line.
Validation performed at: 6/28/2023 10:04:11 PM UTC

[ghost]

Tagging subscribers to this area: @dotnet/area-extensions-configuration
See info in area-owners.md if you want to be subscribed.

Issue Details

---

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=280353
Build error leg or test failing: Microsoft.Extensions.Configuration.Binder.Tests.ConfigurationBinderTests.BindCanReadStaticProperty
Pull request: #86519

Error Message

Fill the error message using known issues guidance.

{
  "ErrorMessage": "Expected: other stuff",
  "BuildRetry": false,
  "ErrorPattern": "",
  "ExcludeConsoleLog": true
}

Author:	jkoritzinsky
Assignees:	-
Labels:	blocking-clean-ci, area-Extensions-Configuration, Known Build Error
Milestone:	-

[tarekgh]

The failing test is

runtime/src/libraries/Microsoft.Extensions.Configuration.Binder/tests/Common/ConfigurationBinderTests.cs

Line 692 in 1ec5ff8

public void BindCanReadStaticProperty()

The failure is https://dev.azure.com/dnceng-public/public/_build/results?buildId=280353&view=ms.vss-test-web.build-test-results-tab&runId=5559962&resultId=100636&paneView=debug

Assert.Equal() Failure
↓ (pos 0)
Expected: other stuff
Actual:   stuff
↑ (pos 0)


 at Microsoft.Extensions.Configuration.Binder.Tests.ConfigurationBinderTests.BindCanReadStaticProperty() in /_/src/libraries/Microsoft.Extensions.Configuration.Binder/tests/Common/ConfigurationBinderTests.cs:line 705
   at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
   at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr* args, BindingFlags invokeAttr) in /_/src/libraries/System.Private.CoreLib/src/System/Reflection/MethodInvoker.cs:line 59

This is a very weird issue as it looks like the string somehow gets trimmed from the beginning. No idea how this can happen.

We may need to look if this issue can occur again.

[steveharter]

This is likely due to ComplexOptions.StaticProperty being a static property and shared with other tests that could be running at the same time, including another test that sets it to "stuff".

[jkotas]

This was just hit in #93766 that included the attempted fix.

Log https://helix.dot.net/api/2019-06-17/jobs/2a5ba216-8f70-4231-a125-ae077ebca6fa/workitems/Microsoft.Extensions.Configuration.Binder.Tests/console