Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[MONO] Fix libraries outerloop tests #43378

Open
safern opened this issue Oct 14, 2020 · 5 comments
Open

[MONO] Fix libraries outerloop tests #43378

safern opened this issue Oct 14, 2020 · 5 comments
Labels
area-Meta runtime-mono specific to the Mono runtime
Milestone
Future

Comments

@safern
Copy link
Member

safern commented Oct 14, 2020

We added the following build pipeline: https://dev.azure.com/dnceng/public/_build?definitionId=896&_a=summary which runs libraries outerloop tests on mono runtime. It has a considerable amount of failures, so this issue is to track getting it green:

Linux-Release-arm

Helix Queue: (Debian.9.Arm32.Open)Ubuntu.1804.ArmArch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:debian-9-helix-arm32v7-bfcd90a-20200121150037

  • System.Buffers.Tests -- Exit:1 (Console)
  • System.IO.Pipes.Tests -- Exit:1 (Console)
  • System.Net.Security.Tests -- Exit:1 (Console)
  • System.Net.Sockets.Tests -- Exit:1 (Console)
  • System.Runtime.Tests -- Exit:1 (Console)
  • System.Threading.Tasks.Dataflow.Tests -- Exit:1 (Console)
  • System.Threading.Tasks.Tests -- Exit:1 (Console)

Linux_musl-Release-x64

Helix Queue: (Alpine.312.Amd64.Open)ubuntu.1604.amd64.open@mcr.microsoft.com/dotnet-buildtools/prereqs:alpine-3.12-helix-20200601195603-e06dc59

All workitems failing with:

----- start Thu Oct 8 23:49:58 UTC 2020 =============== To repro directly: =====================================================
pushd .
/root/helix/work/correlation/dotnet exec --runtimeconfig Common.Tests.runtimeconfig.json --depsfile Common.Tests.deps.json xunit.console.dll Common.Tests.dll -xml testResults.xml -nologo -nocolor -trait category=OuterLoop -notrait category=IgnoreForCI -notrait category=failing 
popd
===========================================================================================================
/root/helix/work/workitem /root/helix/work/workitem
Failed to load /root/helix/work/correlation/shared/Microsoft.NETCore.App/6.0.0/libcoreclr.so, error: Error loading shared library libexecinfo.so.1: No such file or directory (needed by /root/helix/work/correlation/shared/Microsoft.NETCore.App/6.0.0/libcoreclr.so)
./RunTests.sh: line 161:    21 Segmentation fault      (core dumped) "$RUNTIME_PATH/dotnet" exec --runtimeconfig Common.Tests.runtimeconfig.json --depsfile Common.Tests.deps.json xunit.console.dll Common.Tests.dll -xml testResults.xml -nologo -nocolor -trait category=OuterLoop -notrait category=IgnoreForCI -notrait category=failing $RSP_FILE
/root/helix/work/workitem
----- end Thu Oct 8 23:49:58 UTC 2020 ----- exit code 139 ----------------------------------------------------------
exit code 139 means SIGSEGV Illegal memory access. Deref invalid pointer, overrunning buffer, stack overflow etc. Core dumped.

Linux-Release-x64

Helix Queue: Centos.7.Amd64.Open

  • System.Buffers.Tests -- Exit:1 (Console)
  • System.IO.Pipes.Tests -- Exit:1 (Console)
  • System.Net.Security.Tests -- Exit:1 (Console)
  • System.Runtime.Tests -- Exit:1 (Console)
  • System.Text.RegularExpressions.Tests -- Exit:1 (Console)

Helix Queue: RedHat.7.Amd64.Open

  • System.Buffers.Tests -- Exit:1 (Console)
  • System.IO.Pipes.Tests -- Exit:1 (Console)
  • System.Net.Security.Tests -- Exit:1 (Console)
  • System.Runtime.Tests -- Exit:1 (Console)

Helix Queue: SLES.15.Amd64.Open

  • System.Buffers.Tests -- Exit:1 (Console)
  • System.IO.Pipes.Tests -- Exit:1 (Console)
  • System.Net.Security.Tests -- Exit:1 (Console)
  • System.Runtime.Tests -- Exit:1 (Console)
  • System.Text.RegularExpressions.Tests -- Exit:1 (Console)

Helix Queue: (Fedora.32.Amd64.Open)ubuntu.1604.amd64.open@mcr.microsoft.com/dotnet-buildtools/prereqs:fedora-32-helix-20200512010618-efb9f14

  • System.Buffers.Tests -- Exit:1 (Console)
  • System.IO.Pipes.Tests -- Exit:1 (Console)
  • System.Net.Security.Tests -- Exit:1 (Console)
  • System.Runtime.Tests -- Exit:1 (Console)
  • System.Text.RegularExpressions.Tests -- Exit:1 (Console)

Helix Queue: (Ubuntu.1910.Amd64.Open)ubuntu.1604.amd64.open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-19.10-helix-amd64-cfcfd50-20191030180623

  • System.Buffers.Tests -- Exit:1 (Console)
  • System.IO.Pipes.Tests -- Exit:1 (Console)
  • System.Net.Security.Tests -- Exit:1 (Console)
  • System.Net.Sockets.Tests -- Exit:1 (Console)
  • System.Runtime.Tests -- Exit:1 (Console)
  • System.Text.RegularExpressions.Tests -- Exit:137 (Console)

Helix Queue: (Debian.10.Amd64.Open)ubuntu.1604.amd64.open@mcr.microsoft.com/dotnet-buildtools/prereqs:debian-10-helix-amd64-bfcd90a-20200121150006

  • System.Buffers.Tests -- Exit:1 (Console)
  • System.IO.Pipes.Tests -- Exit:1 (Console)
  • System.Net.Security.Tests -- Exit:1 (Console)
  • System.Runtime.Tests -- Exit:1 (Console)
  • System.Text.RegularExpressions.Tests -- Exit:1 (Console)

Browser-Release-wasm

Helix Queue: Ubuntu.1804.Amd64.Open

  • System.Collections.Concurrent.Tests -- Exit:233 (Console)
  • System.Collections.NonGeneric.Tests -- Exit:233 (Console)
  • System.Console.Tests -- Exit:233 (Console)
  • System.Diagnostics.DiagnosticSource.Tests -- Exit:233 (Console)
  • System.Globalization.Tests -- Exit:233 (Console)
  • System.IO.Compression.Tests -- Exit:-3 (Console)
  • System.IO.FileSystem.Tests -- Exit:233 (Console)
  • System.Memory.Tests -- Exit:-3 (Console)
  • System.Net.WebSockets.Tests -- Exit:233 (Console)
  • System.Net.WebSockets.WebSocketProtocol.Tests -- Exit:233 (Console)
  • System.Runtime.Tests -- Exit:233 (Console)
  • System.Security.SecureString.Tests -- Exit:233 (Console)
  • System.Text.Json.Tests -- Exit:-3 (Console)
  • System.Threading.Tasks.Dataflow.Tests -- Exit:-3 (Console)
  • System.Threading.Tasks.Parallel.Tests -- Exit:-3 (Console)
  • System.Threading.Tasks.Tests -- Exit:-3 (Console)
  • System.Threading.Tests -- Exit:233 (Console)
  • System.Threading.Timer.Tests -- Exit:233 (Console)
  • System.Transactions.Local.Tests -- Exit:233 (Console)

OSX-Release-x64

Helix Queue: OSX.1015.Amd64.Open

  • System.Buffers.Tests -- Exit:1 (Console)
  • System.Diagnostics.DiagnosticSource.Tests -- Exit:-3 (Console)
  • System.Net.Security.Tests -- Exit:1 (Console)
  • System.Runtime.Tests -- Exit:1 (Console)
  • System.Threading.Tasks.Dataflow.Tests -- Exit:1 (Console)
  • System.Threading.Tasks.Tests -- Exit:1 (Console)

Helix Queue: OSX.1014.Amd64.Open

  • System.Buffers.Tests -- Exit:1 (Console)
  • System.Diagnostics.DiagnosticSource.Tests -- Exit:-3 (Console)
  • System.Net.Security.Tests -- Exit:1 (Console)
  • System.Runtime.Tests -- Exit:1 (Console)
  • System.Threading.Tasks.Dataflow.Tests -- Exit:1 (Console)
  • System.Threading.Tasks.Tests -- Exit:1 (Console)

Helix Queue: OSX.1013.Amd64.Open

  • System.Buffers.Tests -- Exit:1 (Console)
  • System.Diagnostics.DiagnosticSource.Tests -- Exit:-3 (Console)
  • System.Net.Security.Tests -- Exit:1 (Console)
  • System.Runtime.Tests -- Exit:1 (Console)
  • System.Text.Json.Tests -- Exit:-3 (Console)
  • System.Threading.Tasks.Tests -- Exit:1 (Console)

Windows_NT-Release-x64

Helix Queue: Windows.10.Amd64.Server19H1.Open

  • System.Buffers.Tests -- Exit:1 (Console)
  • System.Diagnostics.Process.Tests -- Exit:1 (Console)
  • System.DirectoryServices.AccountManagement.Tests -- Exit:1 (Console)
  • System.DirectoryServices.Tests -- Exit:1 (Console)
  • System.IO.Compression.Brotli.Tests -- Exit:1 (Console)
  • System.IO.Compression.Tests -- Exit:1 (Console)
  • System.IO.FileSystem.Watcher.Tests -- Exit:1 (Console)
  • System.Management.Tests -- Exit:1 (Console)
  • System.Net.WebSockets.Client.Tests -- Exit:1 (Console)
  • System.Net.WebSockets.Tests -- Exit:1 (Console)
  • System.Net.WebSockets.WebSocketProtocol.Tests -- Exit:1 (Console)
  • System.Runtime.Tests -- Exit:1 (Console)
  • System.Text.Json.Tests -- Exit:-3 (Console)
  • System.Threading.Tasks.Dataflow.Tests -- Exit:1 (Console)
  • System.Threading.Tasks.Tests -- Exit:1 (Console)
  • System.Windows.Extensions.Tests -- Exit:1 (Console)

Windows_NT-Release-x86

Helix Queue: Windows.10.Amd64.ServerRS5.Open

  • System.Buffers.Tests -- Exit:1 (Console)
  • System.Diagnostics.Process.Tests -- Exit:1 (Console)
  • System.DirectoryServices.AccountManagement.Tests -- Exit:1 (Console)
  • System.DirectoryServices.Tests -- Exit:1 (Console)
  • System.IO.Compression.Brotli.Tests -- Exit:1 (Console)
  • System.IO.Compression.Tests -- Exit:1 (Console)
  • System.IO.FileSystem.Watcher.Tests -- Exit:1 (Console)
  • System.Management.Tests -- Exit:1 (Console)
  • System.Net.WebSockets.Client.Tests -- Exit:1 (Console)
  • System.Net.WebSockets.Tests -- Exit:1 (Console)
  • System.Net.WebSockets.WebSocketProtocol.Tests -- Exit:1 (Console)
  • System.Runtime.Tests -- Exit:1 (Console)
  • System.Threading.Tasks.Tests -- Exit:1 (Console)
  • System.Windows.Extensions.Tests -- Exit:1 (Console)

cc: @directhex @akoeplinger @steveisok @lewing @marek-safar
@safern safern added area-Meta runtime-mono specific to the Mono runtime labels Oct 14, 2020
@safern safern added this to the 6.0.0 milestone Oct 14, 2020
@safern
Copy link
Member Author

safern commented Oct 14, 2020 •
edited
Loading

By the way, to run outerloop tests, you need to pass either: -testscope outerloop when using the root build scripts or, when invoking an individual test project you can use MSBuild property: /p:TestScope=outerloop.

Also, to run this pipeline in a PR you can comment on your PR:

/azp run runtime-libraries-mono outerloop

@steveisok
Copy link
Member

Thanks for putting this together

@danmoseley
Copy link
Member

@mdh1418 where are we at with this one -- is there updated data? Do you expect more here for 6.0?

@danmoseley
Copy link
Member

All the logs here are gone... suggest moving this to 7.0 and pursuing after GA.

@akoeplinger akoeplinger modified the milestones: 6.0.0, 7.0.0 Aug 12, 2021
@danmoseley danmoseley modified the milestones: 7.0.0, Future Jul 6, 2022
@carlossanlop
Copy link
Member

Hit a System.Net.Security.Tests failure in mono Linux x64 here: #71770

But it's Debug, so I'm not entirely sure if it's the same. Just wanted to put it in your radar, @dotnet/ncl

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
area-Meta runtime-mono specific to the Mono runtime
Projects
None yet
Milestone
Future
Development

No branches or pull requests
5 participants
@steveisok @carlossanlop @akoeplinger @danmoseley @safern