[NativeAOT-iOS] MacCatalyst fails to start/log nativeaot.SmokeTests tests

[matouskozak]

Build Information

Build: https://dev.azure.com/dnceng-public/public/_build/results?buildId=804204
Build error leg or test failing:

• nativeaot.SmokeTests.Reflection,
• nativeaot.SmokeTests.StackTraceMetadata
• nativeaot.SmokeTests.Preinitialization

Affected CI: maccatalyst-arm64 Release AllSubsets_NativeAOT_RuntimeTests (runtime-extra-platforms)

The test are failing either with:
XHarness exit code: 83 (APP_LAUNCH_FAILURE)

[05:10:37.6845280] The application cannot be opened for an unexpected reason, error=Error Domain=NSOSStatusErrorDomain Code=-600 "procNotFound: no eligible process with specified descriptor" UserInfo={_LSLine=387, _LSFunction=_LSAnnotateAndSendAppleEventWithOptions}

or
XHarness exit code: 82 (RETURN_CODE_NOT_SET)

Failed to detect application's exit code. The log file was empty / not found at /tmp/helix/working/9D2308EA/w/9FFA08F1/uploads/Reports/nativeaot.SmokeTests.Reflection/Reflection/net.dot.nativeaot_SmokeTests_Reflection.log

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorPattern": "nativeaot/SmokeTests/.+\\[FAIL\\]",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=804204
Error message validated: [nativeaot/SmokeTests/.+\[FAIL\]]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 9/12/2024 10:07:58 AM UTC

Report

Build	Definition	Test	Pull Request
846587	dotnet/runtime	nativeaot.SmokeTests.TrimmingBehaviors.WorkItemExecution
844985	dotnet/runtime	nativeaot.SmokeTests.StackTraceMetadata.WorkItemExecution
844451	dotnet/runtime	nativeaot.SmokeTests.Reflection.WorkItemExecution
843170	dotnet/runtime	nativeaot.SmokeTests.StackTraceMetadata.WorkItemExecution
842642	dotnet/runtime	nativeaot.SmokeTests.StackTraceMetadata.WorkItemExecution
842411	dotnet/runtime	nativeaot.SmokeTests.StackTraceMetadata.WorkItemExecution
842389	dotnet/runtime	nativeaot.SmokeTests.StackTraceMetadata.WorkItemExecution
842092	dotnet/runtime	nativeaot.SmokeTests.StackTraceMetadata.WorkItemExecution

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
0	0	8

[dotnet-policy-service]

Tagging subscribers to 'os-maccatalyst': @vitek-karas, @kotlarmilos, @ivanpovazan, @steveisok, @akoeplinger
See info in area-owners.md if you want to be subscribed.

[dotnet-policy-service]

Tagging subscribers to this area: @directhex, @matouskozak
See info in area-owners.md if you want to be subscribed.

[matouskozak]

Could it be related to #102882 @ivanpovazan @kotlarmilos ?

[ivanpovazan]

Could it be related to #102882 @ivanpovazan @kotlarmilos ?

I don't think so, that issue did disable the test, but we had a failure with it on tvos-arm64 even before in:
#90460

If I remember correctly the behavior was similar to what you are getting ie the device log showed correct output in the logs but test return value was not what the test runner expected.

I would check if we are properly rooting every possible test infra assembly when we build these tests with NativeAOT.

[ivanpovazan]

@matouskozak @kotlarmilos could you check this:

I would check if we are properly rooting every possible test infra assembly when we build these tests with NativeAOT.

[ivanpovazan]

@matouskozak just FYI: updated the ErrorPattern and a newer build failing with the same reason.