Closed dreampiggy closed 4 days ago
Hello @dreampiggy! Thank you for reporting this! We will investigate the issue and come back to you as soon as we have any updates!
@MaksimZhukov @sergei-pyshnoi I can echo this report; we run into a similar issue in https://github.com/StanfordBDHG/SwiftPackageTemplate/pull/17
Testing failed:
Simulator device returned an error for the requested operation.
TestAppUITests-Runner encountered an error (Failed to install or launch the test runner. (Underlying Error: Simulator device returned an error for the requested operation. The system shell probably crashed. (Underlying Error: The request to terminate "edu.stanford.templatepackage.testapp.uitests.xctrunner" failed. The system shell probably crashed.)))
Hello @dreampiggy . Can you try to switch to Xcode 15.4
? Looks like your behavior is fixed with new version.
Thank you for working on this @sergei-pyshnoi! I can't speak for others, but we have tried to validate if this is fixed with Xcode 15.4 but we still see that watchOS as well as visionOS builds don't run on the GitHub hosted runners while they work fine on our self-hosted macOS runners.
This can be replicated by forking https://github.com/StanfordBDHG/SwiftPackageTemplate and removing the runsonlabels: '["macOS", "self-hosted"]'
inputs to our reusable workflow for the watchOS and visionOS builds running a minimal application with no logic and a UI test that only checks two texts on screen.
@dreampiggy - Does it help you out switching to Xcode 15.4?
@dreampiggy, We hope you try to switch to Xcode 15.4 then your code is fixed. So, we are closing the issue.
@sureshe456 @sergei-pyshnoi Should we create a separate issue that tracks the same problem and description as it doesn't seem to be resolved as noted in https://github.com/actions/runner-images/issues/9511#issuecomment-2197753402 or would you like to re-open this issue?
Happy to provide some additional context if you need any additional elements to resolve the problem. We just recently also noticed it in https://github.com/techprimate/TPPDF/pull/384 so it is not constrained to our setup and Actions.
Description
You can see https://github.com/actions/runner/issues/3169 as well, which use markdown and has a better page render
Background
I recently switch from
macos-13
Intel based runner image into the arm64macos-14
one, and found a strange issue.For
macos-13
, since it's Intel based, and does not has visionOS SDK and simulator installed, so I use the tricks from community:It used to work.
Current status
However, when switch into the
macos-14
arm based machine. I remove the tricks above ⬆️ because the visionOS toolchain is already installed in Xcode 15.2 on arm based machine.So, I choose to just run the test case, it will run the following command on GitHub runner
However, the test seems never booted, it just suck and wait for 30 minutes then timeout. I have to cancel the job by myself.
From the link I provided https://github.com/SDWebImage/SDWebImage/actions/runs/8029051513, You can see, other jobs (iOS/macOS/tvOS) run the similar command and just work.
Only the Apple Vision Simulator will suck and no output at all. It will suck for 30 minutes and I have to cancel itself.
Platforms affected
Runner images affected
Image version and build link
The action link: https://github.com/SDWebImage/SDWebImage/actions/runs/8029051513
Is it regression?
Maybe, but this is my first time to use macos-14 image and found this issue (previouslly macos-13 use Intel Mac, which seems does not has issue)
Expected behavior
The Github Runner image
macos-14
should works when runningxcodebuild test
command for Apple Vision Pro simulator. Just like local Mac environment.Actual behavior
See above in issue descrption, the Github Runner suck at
xcodebuild test
on Apple Vision Pro simulator only, not other platforms.My Local test
I have a macOS 13.5 running on Apple MacBook Pro 13 (M1 Pro chip), and running the command, it just run succfully.
Note that
Testing started
in stdout.However, only GitHub runner will suck without any extra output.
Possible Reason
Because I can not log-on the GitHub runner VM Mac machine, so I can not understand what's actually happended. Is this something like a GUI alert poped-up which breaks the
xcodebuild test
command to continue ?Or, maybe something about the compatible issue Xcode 15's Apple Vision Pro Simulator on GitHub action. Which can not been booted at all. (But however, I try to use
xcrun simctl boot "Apple Vision Pro"
on GitHub action, it returns 0 and success.)Repro steps
To Reproduce Steps to reproduce the behavior:
Goto https://github.com/dreampiggy/SDWebImage/tree/ci/vision (this is fork repo) Create a PR to the https://github.com/dreampiggy/SDWebImage, target branch is master (Or simple, just click https://github.com/SDWebImage/SDWebImage/compare/master...dreampiggy:SDWebImage:ci/vision?expand=1) See the GitHub runner running status, it will suck as Unit Test (visionOS) job, but all other jobs will pass.