[NativeAOT] System.Reflection.Tests timeout/hang

[jkotas]

----- start Wed May 18 01:17:17 UTC 2022 =============== To repro directly: =====================================================
pushd .
chmod +rwx System.Reflection.Tests ^&^& ./System.Reflection.Tests -notrait category=IgnoreForCI -notrait category=OuterLoop -notrait category=failing 
popd
===========================================================================================================
/root/helix/work/workitem/e /root/helix/work/workitem/e
Running assembly:System.Reflection.Tests, Version=7.0.0.0, Culture=neutral, PublicKeyToken=cc7b13ffcd2ddd51

...
[EXECUTION TIMED OUT]
Exit Code:-3Executor timed out after 2700 seconds and was killed

[dotnet-issue-labeler]

I couldn't figure out the best area label to add to this issue. If you have write-permissions please help me learn by adding exactly one area label.

[jkotas]

Hit in #69468

[jkotas]

@LakshanF Looks like the System.Reflection tests are hitting intermittent hang in the CI. We either need to get to the bottom of it quickly or disabled the tests again.

[jkotas]

Hit in #69451

[jkotas]

Hit in #69469

[jkotas]

This is failing too often. Submitted #69477

[LakshanF]

Yes, I was concerned about this even though re-running seems to work but timeouts are frequent enough to be a concern. Some observations;

• The time limit is 45 mins but the job takes about 25 mins when it passes. So likely some other issue happening rather than the needed time.
• Swapping platform to win-x64 from linux-arm64 worked but need to run multiple runs to get a better read (also, @MichalStrehovsky had some concerns with CoreCLR tests not working in Linux-arm64 (which was the swapped test run), which I didn't investigate too much since the one time run passed)

[MichalStrehovsky]

(also, @MichalStrehovsky had some concerns with CoreCLR tests not working in Linux-arm64 (which was the swapped test run)

The edit here: #69284 (comment) was to the CoreCLR test leg (running tests under src/tests), not the libraries test leg (running xunit tests under src/libraries), so it didn't affect System.Reflection.Tests runs. My concern was that adding anything ARM64 in that section won't work. ARM64 testing currently only works for the libs tests and those legs are defined lower in the runtime.yaml file.

[MichalStrehovsky]

This is not fixed, just worked around. The test still hangs on Linux. Reopening.

[MichalStrehovsky]

I see, so we now have a new bug for the same thing. Closing in favor of #70010...