[MacCatalyst][libraries] Test suites flake with App Crash on CI

[mdh1418]

In https://github.com/dotnet/runtime/pull/53197, a few test suites were flaking on CI with App Crash

All of the crashes are of the same form

Architecture x64 Microsoft.CSharp.Tests - Passes locally but not ran on CI System.Diagnostics.Tracing.Tests - Still crashed System.Dynamic.Runtime.Tests - Still crashed System.Linq.Expressions.Tests - Still crashed System.Linq.Parallel.Tests - Passed on CI System.Text.Json.Tests - Still crashed

Architecture Arm64 System.IO.FileSystem.Watcher.Tests - Didn't crash on run 1 System.Net.WebSockets.Client.Tests - Didn't crash on run 1

[dotnet-issue-labeler[bot]]

I couldn't figure out the best area label to add to this issue. If you have write-permissions please help me learn by adding exactly one area label.

[steveisok]

@mdh1418 the logs don't tell us much. This isn't high priority, but when you have a moment, try to run this locally through xcode and see what it says there.

[steveisok]

@premun @mandel-macaque The apps reliably crash on CI really early on. It doesn't seem like they even execute and mlaunch core dumps. If you pull the same app file used on helix and run it local, there is no problem.

@mdh1418 The same crashes seem to happen for iOS and tvOS. Can you please disable for all?

[premun]

@steveisok I will have a look at the app (probably tomorrow). Do you know - did you try locally on the same Xcode/iOS version?

I have already seen one BCL app before that would:

• Crash on iOS 13.5
• Time out on iOS 14.2
• Succeed on iOS 14.4 (which is kind of surprising, I would have thought we won't be iOS version sensitive much)

[steveisok]

I didn't match the xcode version w/ whatever is on CI.

On the app you saw crash, did it actually execute or did mlaunch bail earlier?

[premun]

I am tracking the investigation here - https://github.com/dotnet/xharness/issues/692 - as it was already referenced in couple of places

[lambdageek]

https://github.com/dotnet/runtime/pull/59182 may help with System.Text.Json tests

[steveisok]

@mkhamoyan Can you check on CI to see if this still happens?

[mdh1418]

The test suites under x64 still pass locally, didn't check CI

[mkhamoyan]

@steveisok these ones are still failing on CI

• System.Dynamic.Runtime
• System.Net.Requests
• System.Net.Security

rest of them are passing on CI https://github.com/dotnet/runtime/pull/72445.

[mkhamoyan]

Only failing tests that are still disabled are System.Net.Security and System.Net.Requests. They are failing with following exception.

.

[mkhamoyan]

cc @vitek-karas

[vitek-karas]

/cc @simonrozsival