[mobile] Overview of mobile related CI failures

[matouskozak]

Description

This issue provides an overview of dotnet/runtime CI (main branch) failures related to .NET mobile platforms. This tracking issue is updated manually. Feel free to update the issue if you encounter any out-of-date information.

Platforms

The failures are divided per mobile platform when possible or categorized as "Other Failures".

iOS/TvOS/MacCatalyst

Issue	Status	Comment	Impact
https://github.com/dotnet/runtime/issues/106797	Investigating	tvOS/iOS-arm64 failures inside ClassLoader runtime tests, BigArray_32_1 is too big	Low
https://github.com/dotnet/runtime/issues/105804	Investigating	NativeAOT-MacCatalyst-arm64 infra issue with smoke tests start/logging	Low
https://github.com/dotnet/runtime/issues/104431	Investigating	MacCatalyst and iOS (sim x64) fail on iOS.Simulator.LambdaCompilerAot tests, attempting to JIT compile method in AOT-only mode, not clear cause, potential fix https://github.com/dotnet/runtime/pull/104097
https://github.com/dotnet/runtime/issues/104162	Investigating	TvOS fails on System.Runtime.Serialization.Xml.XsdDataContractExporterTests.ExporterTypesTests.TypesTest tests, not clear cause, potential fix https://github.com/dotnet/runtime/pull/104097
https://github.com/dotnet/runtime/issues/103692	Investigating	TvOS fails on System.Numerics.Tensors tests, failed to sign app / time-out on dedup step.	Low
https://github.com/dotnet/runtime/issues/101371	untriaged	MacCatalyst occassionally fails on System.IO.IsolatedStorage tests
https://github.com/dotnet/runtime/issues/101692	untriaged	TvOS fails on System.Formats.Tar tests
https://github.com/dotnet/runtime/issues/107346	Resolved	NativeAOT-ios runtime tests are not properly sent over to helix	Medium
https://github.com/dotnet/runtime/issues/107309	Resolved	iOS/tvOS-arm64, System.Runtime.Serialization.Formatters.pdb" because it was not found.	Medium
https://github.com/dotnet/runtime/issues/106256	Resolved	tvOS/iOS-arm64 failures inside System.Runtime.Tests in Decimal+BigInteger	Medium
https://github.com/dotnet/runtime/issues/105753	Resolved	tvOS/iOS-arm64 failures inside System.Runtime.Tests in Decimal+BigInteger	Low
https://github.com/dotnet/runtime/issues/104881	Resolved	TvOS/iOS x64 simulators + MacCatalyst fail on System.Diagnostics.Tracing tests
https://github.com/dotnet/runtime/issues/105251	Resolved	Occasional iOS crash (looks to only happen iPhone XR) at System.Threading.LazyInitializer:EnsureLockInitialized, caused by LLVM 19 bump	Low
https://github.com/dotnet/runtime/issues/105932	Resolved	tvOS-arm64, MacCatalyst-arm64, tvOSSimulator-x64 failures in System.Globalization tests when retrieving native sort key	Medium
https://github.com/dotnet/runtime/issues/105688	Resolved	MacCatalyst-arm64, TvOS-arm64, TvOSSimulator-x64 failures in System.Net.Sockets tests	Medium
https://github.com/dotnet/runtime/issues/105322	Resolved	TvOS-arm64 + TvOS/iOS x64 simulators failures in System.Runtime.Extensions tests, newly introduced TestCpuUsage scenario
https://github.com/dotnet/runtime/issues/105202	Resolved	TvOS/iOS x64 simulators + MacCatalyst fail on System.Diagnostics.DiagnosticSource tests
https://github.com/dotnet/runtime/issues/105537	Resolved	TvOS-arm64 Security.Crypto, Runtime.Intrinsics, Bcl.Memory test failure, likely caused by Shuffle intrinsics	Large
https://github.com/dotnet/runtime/issues/104161	Resolved	Almost all Apple mobile targets fail on System.Security.Cryptography.X509Certificates tests, notified suspects
https://github.com/dotnet/runtime/issues/103982	Resolved	Linking issue. https://github.com/dotnet/runtime/pull/103988
https://github.com/dotnet/runtime/issues/82637	Resolved	Apple device connection failures, causing all apple device jobs to crash due to a trimming issue. https://github.com/dotnet/runtime/pull/104028
https://github.com/dotnet/runtime/issues/103694	Disabled	TvOS fails on System.Text.Json tests, Tagged author of https://github.com/dotnet/runtime/pull/103322
https://github.com/dotnet/runtime/issues/101367	Resolved	TvOS fails on System.Memory tests
https://github.com/dotnet/runtime/issues/104430	Disabled	TvOS/iOS JIT_Directed runtime tests failure due to missing DLL
https://github.com/dotnet/runtime/issues/107246	Closed	iOS-sim x64 failures in PhysicalFileProviderTests.TokenForEmptyFilter	Low

Android

Issue	Status	Comment	Impact
https://github.com/dotnet/runtime/issues/102646	Investigating	Android x64 timeouts when installing the .apk
https://github.com/dotnet/runtime/issues/107551	Resolved	Android x64 runtime tests are not getting sent to Helix	High
https://github.com/dotnet/runtime/issues/105203	Resolved	Android x86 emulator fails on System.Diagnostics.DiagnosticSource tests
https://github.com/dotnet/runtime/issues/105325	Disabled	Android-arm32 out-of-memory in System.Security.Cryptography tests
https://github.com/dotnet/dnceng/issues/3382	Resolved	ubuntu.2204.amd64.android.29.open queue down, Infra issue, x64/86 emulators are timing out
https://github.com/dotnet/runtime/issues/104709, https://github.com/dotnet/dnceng/issues/3405	Resolved	Android failures on System.Net.Sockets and Ping tests, network unreachable. Possibly Infra issue.
https://github.com/dotnet/runtime/issues/104010	Resolved	Arm32/Arm64/x64/x86 Androids fail on System.Net.Security tests, tagged author of suspected PR
https://github.com/dotnet/runtime/issues/104030	Resolved	Arm32/Arm64 Androids fail on System.Security.Cryptography tests, tagged author of suspected PR
https://github.com/dotnet/runtime/issues/100281	Disabled	Linux Bionic fails across variety of test suits

Other Failures

Issue	Status	Comment	Impact
https://github.com/dotnet/runtime/issues/108515	Untriaged	MiniJIT and Interpreter occasionally gets killed on System.Formats.Nrbf tests	Low
https://github.com/dotnet/runtime/issues/101370	Investigating	Interpreter occasionally fails on System.Data.Odbc tests
https://github.com/dotnet/runtime/issues/107244, https://github.com/dotnet/runtime/issues/107254	Disabled	Widespread mobile failures in TensorExtensionsTwoSpanInSpanOut	High
https://github.com/dotnet/runtime/issues/105933	Test Removed	Interpreter failures in 452950 GC regressions test	Low
https://github.com/dotnet/runtime/issues/105395	Resolved	Linux x64 fullAOT-mini Methodical_* failures	Medium
https://github.com/dotnet/runtime/issues/105319	Resolved	Android/iOSSimulator/MacCatalyst/Linux x64 build failures due to LLVM 19 update	Critical
https://github.com/dotnet/runtime/issues/106071	Disabled	Linux x64 fullAOT-mini/llvm EmptyStructs assert crash	Low
https://github.com/dotnet/runtime/issues/103754	Disabled	Mono Windows fails on BackwardsCompatibility_DowngradeToHttp11 test
https://github.com/dotnet/runtime/issues/103406	Resolved	System.Resources.Extensions.Tests.FormattedObject fails across all mobile targets

Note that the "Impact" column represents impact of the issue to the CI health/state and doesn't necessary correlate with final impact to customer apps.

[dotnet-policy-service[bot]]

Tagging subscribers to 'os-ios': @vitek-karas, @kotlarmilos, @ivanpovazan, @steveisok, @akoeplinger See info in area-owners.md if you want to be subscribed.

[dotnet-policy-service[bot]]

Tagging subscribers to 'arch-android': @vitek-karas, @simonrozsival, @steveisok, @akoeplinger See info in area-owners.md if you want to be subscribed.

[dotnet-policy-service[bot]]

Tagging subscribers to 'os-tvos': @vitek-karas, @kotlarmilos, @ivanpovazan, @steveisok, @akoeplinger See info in area-owners.md if you want to be subscribed.

[dotnet-policy-service[bot]]

Tagging subscribers to 'os-maccatalyst': @vitek-karas, @kotlarmilos, @ivanpovazan, @steveisok, @akoeplinger See info in area-owners.md if you want to be subscribed.

[steveisok]

@matouskozak https://github.com/dotnet/runtime/issues/103406 needs a tweak to not run these tests as BinaryFormatter is no longer supported

[matouskozak]

@matouskozak #103406 needs a tweak to not run these tests as BinaryFormatter is no longer supported

You're right, @adamsitnik is working on that in https://github.com/dotnet/runtime/pull/103471.