Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Darwin Build_Release failure on Helix tests - Tests timing out #40074

Open
MiYanni opened this issue Apr 9, 2024 · 7 comments
Open

Darwin Build_Release failure on Helix tests - Tests timing out #40074

MiYanni opened this issue Apr 9, 2024 · 7 comments

Comments

@MiYanni
Copy link
Member

MiYanni commented Apr 9, 2024

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=635799
Build error leg or test failing: Microsoft.DotNet.MSBuildSdkResolver.Tests.dll.3.WorkItemExecution
Pull request: #40059

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": "END OF WORK ITEM LOG: Command timed out, and was killed",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=635799
Error message validated: [END OF WORK ITEM LOG: Command timed out, and was killed]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 4/9/2024 5:21:23 PM UTC

Report

Build Definition Test Pull Request
814811 dotnet/sdk dotnet-watch.Tests.dll.2.WorkItemExecution #43416
813806 dotnet/sdk Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution #43547
813521 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #43585
2542439 dotnet-sdk dotnet-watch.Tests.dll.1.WorkItemExecution #43039
812799 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43491
812664 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43547
812573 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43456
812416 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43558
812584 dotnet/sdk Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution #43566
812555 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #43368
812354 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43556
811952 dotnet/sdk dotnet-watch.Tests.dll.2.WorkItemExecution #43454
811912 dotnet/sdk dotnet-watch.Tests.dll.2.WorkItemExecution #43540
811550 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution #43488
811480 dotnet/sdk Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution #43493
811481 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43525
811140 dotnet/sdk Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution #43514
810758 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43500
810516 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution #43492
810148 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution #43070
809955 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution #43363
808724 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43459
809128 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43449
808343 dotnet/sdk Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution #43439
808172 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43410
807842 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43429
807687 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43255
807590 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43414
807466 dotnet/sdk dotnet-watch.Tests.dll.2.WorkItemExecution #43409
807252 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #43393
2537346 dotnet-sdk dotnet-watch.Tests.dll.2.WorkItemExecution #42784
2537270 dotnet-sdk dotnet-watch.Tests.dll.2.WorkItemExecution #42784
805979 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution #43370
805272 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #43359
805663 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #42718
805646 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.2.WorkItemExecution
2536293 dotnet-sdk dotnet-watch.Tests.dll.1.WorkItemExecution #42743
805349 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43330
2536055 dotnet-sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #42618
805122 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution #43354
2535811 dotnet-sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.2.WorkItemExecution #42618
804667 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution #43338
804527 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution
804186 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #43324
804071 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #42718
803638 dotnet/sdk Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution #43316
803652 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution #43318
803195 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43299
802849 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #42718
2534605 dotnet-sdk dotnet-watch.Tests.dll.2.WorkItemExecution #42298
802584 dotnet/sdk Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution #42775
802177 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43284
802032 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43286
801845 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43282
801790 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #43255
801238 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution #43227
800578 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43200
800597 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43235
800574 dotnet/sdk dotnet-watch.Tests.dll.2.WorkItemExecution #43209
800385 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution #43259
799858 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #43256
799855 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #43213
799476 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution #43253
799445 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution #43254
799398 dotnet/sdk Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution #43200
797317 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43211
798026 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution #43143
797944 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43199
797695 dotnet/sdk Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution #43232
796868 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43152
797135 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #43200
2530519 dotnet-sdk dotnet-watch.Tests.dll.2.WorkItemExecution #42300
796777 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43197
796728 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43195
796561 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43191
796538 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43190
796517 dotnet/sdk dotnet-watch.Tests.dll.2.WorkItemExecution
796345 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43185
796257 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution #43181
796095 dotnet/sdk dotnet-watch.Tests.dll.2.WorkItemExecution
795967 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #43152
795869 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution #43172
793998 dotnet/sdk dotnet-watch.Tests.dll.2.WorkItemExecution #43085
793930 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #43137
793472 dotnet/sdk Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution #43100
793426 dotnet/sdk dotnet-watch.Tests.dll.2.WorkItemExecution #42937
793341 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43078
793309 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43105
793181 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution #43045
793150 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43100
792120 dotnet/sdk Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution #43058
792111 dotnet/sdk Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution #43066
792064 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #42910
792068 dotnet/sdk Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution #43065
791043 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43048
791149 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43029
791078 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #43020
790769 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #42900
791336 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #43036
790684 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution #43043
Displaying 100 of 152 results

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
0 23 152
@nagilson
Copy link
Member

@tmat May you please look at this dotnet watch failure?

@tmat
Copy link
Member

tmat commented May 20, 2024

@nagilson I checked a few logs from above and it looks like the failures are in release/8.0.1xx branch. That wouldn't have various test infra fixes.

@nagilson
Copy link
Member

Thank you for checking :) @tmat, which test infra fixes are you referring to? It may be worth porting them over to 8.0.1xx. Any disagreements @marcpopMSFT?

@nagilson
Copy link
Member

We also just hit it in main, so there might be another existing problem: #41045

@baronfel
Copy link
Member

@tmat this is popping up again in the rc1 branches, when you get back can you take a look?

@tmat
Copy link
Member

tmat commented Aug 15, 2024

@baronfel I can take a look. Do you have a link to the failed run? The test log should be good enough to determine the issue on main/rc1 branches.

@baronfel
Copy link
Member

The helix timeouts are most of the failed tests in this pipeline, but you can't access them right now due to helix auth issues.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants