System.Text.Json.Tests.Utf8JsonWriterTests.WriteNumbers failing in runtime-extra-platforms

[runfoapp]

System.Text.Json.Tests.Utf8JsonWriterTests.WriteNumbers(formatted: True, skipValidation: False, keyString: ">>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>") [FAIL]
    Assert.Equal() Failure
                                    � (pos 2214982)
    Expected: ���3e\u003e\u003e\u003e\u003e\u003e\u003e\u003e\u003e\u003e\u003���
    Actual:   ���3e\u003e\u003e\u003e\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\03E\u003e\u003e\u003e\u003���
                                    � (pos 2214982)
    Stack Trace:
    /_/src/libraries/System.Text.Json/tests/System.Text.Json.Tests/Utf8JsonWriterTests.cs(5670,0): at System.Text.Json.Tests.Utf8JsonWriterTests.WriteNumbers(Boolean formatted, Boolean skipValidation, String keyString)

Runfo Tracking Issue: System.Text.Json.Tests.Utf8JsonWriterTests.WriteNumbers failing in runtime-extra-platforms

Build	Definition	Kind	Run Name	Console	Core Dump	Test Results	Run Client
1599183	runtime-extra-platforms	Rolling	net7.0-windows-Release-x86-CoreCLR_release-Windows.Amd64.Server2022.Open	console.log			runclient.py
1599183	runtime-extra-platforms	Rolling	net7.0-windows-Release-x86-CoreCLR_release-Windows.Amd64.Server2022.Open	console.log			runclient.py

Build Result Summary

Day Hit Count	Week Hit Count	Month Hit Count
0	1	1

[ghost]

Tagging subscribers to this area: @dotnet/area-system-text-json
See info in area-owners.md if you want to be subscribed.

Issue Details

---

Runfo Creating Tracking Issue (data being generated)

Author:	runfoapp[bot]
Assignees:	-
Labels:	area-System.Text.Json, untriaged
Milestone:	-

[elinor-fung]

Failed in build 1599183
Passed in build 1597902

Diff: ebcd332...56fcb74

[danmoseley]

This is the only time this test has ever failed. I don't see any plausible changes in the diff range, so I think it's sporadic. We will have to wait and see whether we get a pattern in future events.

TestResults
| join kind=inner WorkItems on WorkItemId
| join kind=inner Jobs on JobId
//| where Started >= datetime(2022-01-01)
| where Result == "Fail"
| where  Method  == "WriteNumbers"

JobId	WorkItemId	EventId	JobName	WorkItemName	WorkItemFriendlyName	Type	Method	ArgumentHash	Arguments	Result	Duration	Exception	Message	StackTrace	Traits	Reason	Attempt	AzurePipelinesTestRunId	AzurePipelinesTestResultId	JobId1	WorkItemId1	JobName1	Name	FriendlyName	Status	PassCount	FailCount	SkipCount	WarnCount	Queued	Started	Finished	ExitCode	ConsoleUri	MachineName	WorkItemType	Uri	PassOnRetryCount	Attempt1	QueueName	LogUploadSeconds	LogSizeBytes	JobId2	Name1	Source	Type1	Build	Creator	System	IsExternal	PullRequestId	Queued1	Started1	Finished1	TestsPass	TestsFail	TestsSkip	ItemsPass	ItemsWarning	ItemsBadExit	ItemsFail	ItemsError	ItemsTimeout	InitialItems	TotalItems	JobList	Properties	QueueName1	ItemsNotRun	TestsPassedOnRetry	ItemsPassedOnRetry	Attempt2	ItemsDeadLetter	QueueAlias	DockerTag	TeamProject	Repository	Branch
19193466	883777509		69b0c0b3-a80c-46e4-8331-0636d30e24f9	fc2b16e1-2a06-4ec1-8eb5-33f774e9da83	System.Text.Json.Tests	System.Text.Json.Tests.Utf8JsonWriterTests	WriteNumbers	ooWPSJaAv/7DxqndtguvShK+oQA=	formatted: True, skipValidation: False, keyString: ">>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>	Fail	0.346		Assert.Equal() Failure ↓ (pos 2214982) Expected: ···3e\u003e\u003e\u003e\u003e\u003e\u003e\u003e\u003e\u003e\u003··· Actual: ···3e\u003e\u003e\u003e\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\03E\u003e\u003e\u003e\u003··· ↑ (pos 2214982)	at System.Text.Json.Tests.Utf8JsonWriterTests.WriteNumbers(Boolean formatted, Boolean skipValidation, String keyString) in /_/src/libraries/System.Text.Json/tests/System.Text.Json.Tests/Utf8JsonWriterTests.cs:line 5670				44674964	189785	19193466	883777509	69b0c0b3-a80c-46e4-8331-0636d30e24f9	fc2b16e1-2a06-4ec1-8eb5-33f774e9da83	System.Text.Json.Tests	Pass	0	0	0	0	2022-02-08 09:55:39.8730000	2022-02-08 10:08:07.5630000	2022-02-08 10:09:27.0490000	0	https://helixre8s23ayyeko0k025g8.blob.core.windows.net/dotnet-runtime-refs-heads-main-69b0c0b3a80c46e483/System.Text.Json.Tests/1/console.38b0e1e1.log?sv=2019-07-07&se=2022-02-28T09%3A55%3A38Z&sr=c&sp=rl&sig=3aTXdnz5QQi%2Bpq6YV2n7ML69dm2L%2FZ9wILZzRr7xbpw%3D	a0004PO	other		0	1	windows.amd64.server2022.open	0	0	19193466	69b0c0b3-a80c-46e4-8331-0636d30e24f9	ci/public/dotnet/runtime/refs/heads/main	test/functional/cli/innerloop/		27		1		2022-02-08 09:55:39.6230000	2022-02-08 09:55:39.6550000	2022-02-08 10:29:37.9990000	97044	12	1260	276	0	0	0	0	1	276	277	https://helixde8s23ayyeko0k025g8.blob.core.windows.net/helix-job-c1340bc9-1ee0-468d-8683-49f787ff0ab3357f8101efd4991a1/job-list-17b6e37a-3c66-4fe4-8c61-714cf7a99872.json?sv=2019-07-07&se=2022-02-28T09%3A55%3A38Z&sr=c&sp=rl&sig=%2FkT9y4SF6y3ZC3prT7oZixpdEFujDzNBNkKiqDEutMc%3D	{"System.JobName":"__default","System.JobId":"457f7e88-dfa2-5bd9-f871-fdf124c2477d","operatingSystem":"Windows.Amd64.Server2022.Open","BuildNumber":"20220208.4","System.PhaseAttempt":"1","runtimeFlavor":"coreclr","System.JobAttempt":"1","Reason":"Schedule","DefinitionName":"runtime-extra-platforms","CollectionUri":"https://dev.azure.com/dnceng/","Project":"public","System.PhaseName":"libraries_test_run_release_coreclr_windows_x86_Release","System.StageAttempt":"1","DefinitionId":"1080","AzurePipelinesTestRunId":"44674964","BuildId":"1599183","configuration":"Release","System.StageName":"__default","architecture":"x86"}	windows.amd64.server2022.open	0	0	0		0	windows.amd64.server2022.open		public	dotnet/runtime	refs/heads/main

[elinor-fung]

Yeah, we seem to have a bunch intermittent failures after the move to Windows.Amd64.Server2022 (switch only finished yesterday, so we don't have a huge number of builds yet). There's a lot of 'red' in that leg - trying to open tracking issues for them all, so we have a better idea of what is affected.

Not sure if any/all are related, but a number of intermittent test failures seem to involve string encoding (at least as someone unfamiliar with them looking at the call stacks / names).

[eiriktsarpalis]

I re-ran @danmoseley's query today and it looks like this was a one-off occurrence. Should we close this?

[eiriktsarpalis]

Closing for now. I'm guessing this would be re-filed if the test failure occurs again?