search

dotnet / maui

.NET MAUI is the .NET Multi-platform App UI, a framework for building native device applications spanning mobile, tablet, and desktop.
https://dot.net/maui
MIT License
22.04k stars 1.73k forks source link

[testing] Run tests iOS and Android emulator tests on Hosted machines #19561

Open rmarinho opened 9 months ago

rmarinho commented 9 months ago

Description

Right now we are using our own pools to run tests for iOS and Android, would be good to try run them on Hosted (fresh machines) to see if it makes the test behaviour better. We already run MacCatalyst in these type of machines

https://devdiv.visualstudio.com/DevDiv/_build/results?buildId=8844377&view=logs&j=8e57b21e-3320-581d-59b8-8586ad754ed3&t=cb636581-d789-5ce3-99c0-15702bc623eb&l=3603

crit: Failed to find compatible device: arm64-v8a, armeabi-v7a, x86, x86_64

https://devdiv.visualstudio.com/DevDiv/_build/results?buildId=8844377&view=logs&j=bc1d4079-a306-5df1-792a-3c37420504d1&t=e7f021c7-089d-579f-93b3-6a2f5e8542b2&l=3698

Exception: System.Threading.ThreadAbortException: Thread was being aborted.
  at (wrapper managed-to-native) System.Threading.Monitor.Monitor_wait(object,int)
  at System.Threading.Monitor.ObjWait (System.Boolean exitContext, System.Int32 millisecondsTimeout, System.Object obj) [0x0002f] in <baaab171478d4061bd9316f48a642f06>:0 
  at System.Threading.Monitor.Wait (System.Object obj, System.Int32 millisecondsTimeout, System.Boolean exitContext) [0x0000e] in <baaab171478d4061bd9316f48a642f06>:0 
  at System.Threading.Monitor.Wait (System.Object obj, System.Int32 millisecondsTimeout) [0x00000] in <baaab171478d4061bd9316f48a642f06>:0 
  at System.Threading.ManualResetEventSlim.Wait (System.Int32 millisecondsTimeout, System.Threading.CancellationToken cancellationToken) [0x00100] in <baaab171478d4061bd9316f48a642f06>:0 
  at System.Threading.Tasks.Task.WaitAllBlockingCore (System.Collections.Generic.LowLevelListWithIList`1[T] tasks, System.Int32 millisecondsTimeout, System.Threading.CancellationToken cancellationToken) [0x00038] in <baaab171478d4061bd9316f48a642f06>:0 
  at System.Threading.Tasks.Task.WaitAll (System.Threading.Tasks.Task[] tasks, System.Int32 millisecondsTimeout, System.Threading.CancellationToken cancellationToken) [0x000e6] in <baaab171478d4061bd9316f48a642f06>:0 
  at System.Threading.Tasks.Task.WaitAll (System.Threading.Tasks.Task[] tasks, System.Int32 millisecondsTimeout) [0x00000] in <baaab171478d4061bd9316f48a642f06>:0 
  at System.Threading.Tasks.Task.WaitAll (System.Threading.Tasks.Task[] tasks) [0x00000] in <baaab171478d4061bd9316f48a642f06>:0 
  at Xamarin.UITest.XDB.Services.Processes.ProcessService.Run (System.String command, System.String arguments) [0x0004f] in <0032cb7f0b9c4ee68b9d6ab88b6d5d42>:0 
  at Xamarin.UITest.XDB.Services.OSX.XcodeService.TestWithoutBuilding (System.String deviceId, System.String xctestrunPath, System.String derivedDataPath) [0x0004d] in <0032cb7f0b9c4ee68b9d6ab88b6d5d42>:0 
  at Xamarin.UITest.XDB.Services.iOSDeviceAgentService.StartTest (Xamarin.UITest.XDB.Services.OSX.UDID UDID) [0x0004e] in <0032cb7f0b9c4ee68b9d6ab88b6d5d42>:0 
  at Xamarin.UITest.XDB.Services.iOSDeviceAgentService+<>c__DisplayClass20_0.<LaunchTestAsync>b__2 () [0x00011] in <0032cb7f0b9c4ee68b9d6ab88b6d5d42>:0 
  at Xamarin.UITest.XDB.Services.iOSDeviceAgentService.WithErrorHandling (System.Int32 eventId, System.Func`1[TResult] action, System.String errorMessage, System.Int32[] successCodes) [0x0000e] in <0032cb7f0b9c4ee68b9d6ab88b6d5d42>:0
ghost commented 9 months ago

We've added this issue to our backlog, and we will work to address it as time and resources allow. If you have any additional information or questions about this issue, please leave a comment. For additional info about issue management, please read our Triage Process.

rmarinho commented 7 months ago

Test run example

https://devdiv.visualstudio.com/DevDiv/_build/results?buildId=9102531&view=results

https://devdiv.visualstudio.com/DevDiv/_build/results?buildId=9102532&view=results