search

actions / runner-images

GitHub Actions runner images
MIT License
10.12k stars 3.05k forks source link

Xcode 14 Simulator Names Inconsistent #6243

Closed bdrelling closed 2 years ago

bdrelling commented 2 years ago

Description

Previously posted a comment on another issue, moving this into it's own thread.

When I wrote the context below, I previously thought the biggest issue would be that my scripts wouldn't work when running Xcode for UI-installed simulators versus CLI-installed simulators. However, even within GitHub Actions' macos-12 runner, the simulators are inconsistent from Xcode 12 and 13 as well, so it's not just an issue of local/remote, but an issue of naming across multiple installations of Xcode.

Context

On macos-12 with Xcode 14.0, when I run xcodebuild -showdestinations on GitHub Actions, I see the following devices for watchOS simulator. As a note, I replaced platform:watchOS Simulator, id:ABCD, OS:9.0 in each output with ... to emphasize the differences in the name property.

{ ... name:Apple Watch SE (44mm) (2nd generation) }
{ ... name:Apple Watch Series 5 (40mm) }
{ ... name:Apple Watch Series 5 (44mm) }
{ ... name:Apple Watch Series 6 (40mm) }
{ ... name:Apple Watch Series 6 (44mm) }
{ ... name:Apple Watch Series 7 (41mm) }
{ ... name:Apple Watch Series 7 (45mm) }
{ ... name:Apple Watch Series 8 (41mm) }
{ ... name:Apple Watch Series 8 (45mm) }
{ ... name:Apple Watch Ultra (49mm) }

But when I run xcodebuild -showdestinations locally (on two different machines) or on GitHub Actions for Xcode 12, 13, etc., I see the following output. Notice that Apple Watch Series 5, 6, and 7 all do not have parenthesis () around the size.

{ ... name:Apple Watch SE (44mm) (2nd generation) }
{ ... name:Apple Watch Series 5 - 40mm }
{ ... name:Apple Watch Series 5 - 44mm }
{ ... name:Apple Watch Series 6 - 40mm }
{ ... name:Apple Watch Series 6 - 44mm }
{ ... name:Apple Watch Series 7 - 41mm }
{ ... name:Apple Watch Series 7 - 45mm }
{ ... name:Apple Watch Series 8 (41mm) }
{ ... name:Apple Watch Series 8 (45mm) }
{ ... name:Apple Watch Ultra (49mm) }

For running tests via xcodebuild test, an exact simulator name has to be specified, but the two don't match. This causes a problem in the event that tests rely on, for example, Apple Watch Series 6 - 44mm, as the same script won't be able to run remotely without a workaround (eg. checking an environment variable to identify GitHub Actions and changing the model).

I can verify that the macos-12 runner has the correct version of Xcode 14.0, using setup-xcode as an example:

> Run maxim-lobanov/setup-xcode@v1
Switching Xcode to version '14.0'...
Xcode is set to 14.0.0 (14A309)

And it matches my local version:

$ xcodebuild -version
Xcode 14.0
Build version 14A309

The only thing I can think of that would be different is that the method for installing simulators might be automated somehow differently for the runners, but I used the UI.

Platforms affected

Runner images affected

Image version and build link

Image: macos-12 Version: 20220912.1 Included Software: https://github.com/actions/runner-images/blob/macOS-12/20220912.1/images/macos/macos-12-Readme.md Image Release: https://github.com/actions/runner-images/releases/tag/macOS-12%2F20220912.1

Is it regression?

No

Expected behavior

I would expect Xcode 14.x tvOS and watchOS simulators to match Xcode 12/13 naming conventions as well as the Xcode 14 naming conventions when installed via the UI.

Actual behavior

Xcode 14.x watchOS simulators installed via command-line are named with parenthesis.

Repro steps

Simply run xcodebuild -showdestinations with a valid scheme to print destinations across multiple environments.

Brett-Best commented 2 years ago

Command ran:

xcodebuild -showdestinations -workspace xxx.xcworkspace -scheme “xxx watchOS - Staging”

Xcode 14.1b1:

        { platform:watchOS Simulator, id:E704BAED-FE7B-474C-B913-DCA9998C007F, OS:9.1, name:Apple Watch SE (40mm) (2nd generation) }
        { platform:watchOS Simulator, id:8C9D2FC9-907E-48CD-9FAE-26DD0EF0657A, OS:9.0, name:Apple Watch SE (44mm) (2nd generation) }
        { platform:watchOS Simulator, id:65E03386-1F57-4E8E-9DB5-49237EE555E6, OS:9.0, name:Apple Watch Series 5 (40mm) }
        { platform:watchOS Simulator, id:66CACF06-A892-4D97-B2DB-4F9E33D2B9B1, OS:9.1, name:Apple Watch Series 5 (40mm) }
        { platform:watchOS Simulator, id:96AAC52C-02B1-4A6D-B500-41D3B501D931, OS:9.0, name:Apple Watch Series 5 (44mm) }
        { platform:watchOS Simulator, id:3FAD648F-8660-4496-93F7-407231A152E0, OS:9.1, name:Apple Watch Series 5 (44mm) }
        { platform:watchOS Simulator, id:F5A1A266-D886-40C1-BC02-13D7EF6D1C85, OS:9.0, name:Apple Watch Series 6 (40mm) }
        { platform:watchOS Simulator, id:6A82988F-EB12-467A-B5C6-3B2A5F5A3363, OS:9.1, name:Apple Watch Series 6 (40mm) }
        { platform:watchOS Simulator, id:EBEEEDEF-EA2B-413A-92B1-B12D5B59D61E, OS:9.0, name:Apple Watch Series 6 (44mm) }
        { platform:watchOS Simulator, id:9D640020-BB34-40B5-B8CE-0EA8319D7FD6, OS:9.1, name:Apple Watch Series 6 (44mm) }
        { platform:watchOS Simulator, id:D87385A1-758A-4D19-8DC0-12E7AB5B607A, OS:9.0, name:Apple Watch Series 7 (41mm) }
        { platform:watchOS Simulator, id:10BC2006-3661-4355-AC01-B506275D7691, OS:9.1, name:Apple Watch Series 7 (41mm) }
        { platform:watchOS Simulator, id:FD9EBD8B-D14A-41E3-9879-935D59284B37, OS:9.0, name:Apple Watch Series 7 (45mm) }
        { platform:watchOS Simulator, id:76D10AAE-2A3B-4E14-A3E7-EDC94F9B1C1C, OS:9.1, name:Apple Watch Series 7 (45mm) }
        { platform:watchOS Simulator, id:F26CFA55-4529-4FE6-931B-5576C53CD5CE, OS:9.0, name:Apple Watch Series 8 (41mm) }
        { platform:watchOS Simulator, id:C0884218-D629-4628-87CF-8F0E97187E88, OS:9.1, name:Apple Watch Series 8 (41mm) }
        { platform:watchOS Simulator, id:99CEC172-171D-4AF7-8B73-7C3DF1F44565, OS:9.0, name:Apple Watch Series 8 (45mm) }
        { platform:watchOS Simulator, id:4B3B2569-A78F-490F-B96D-1EBBAC8D330E, OS:9.1, name:Apple Watch Series 8 (45mm) }
        { platform:watchOS Simulator, id:CC23067F-A844-484B-95CF-D6851403BFB3, OS:9.0, name:Apple Watch Ultra (49mm) }
        { platform:watchOS Simulator, id:99B0FA23-FEB9-4964-8840-5CDBADD60E40, OS:9.1, name:Apple Watch Ultra (49mm) }

Xcode 14:

        { platform:watchOS Simulator, id:E704BAED-FE7B-474C-B913-DCA9998C007F, OS:9.1, name:Apple Watch SE (40mm) (2nd generation) }
        { platform:watchOS Simulator, id:8C9D2FC9-907E-48CD-9FAE-26DD0EF0657A, OS:9.0, name:Apple Watch SE (44mm) (2nd generation) }
        { platform:watchOS Simulator, id:65E03386-1F57-4E8E-9DB5-49237EE555E6, OS:9.0, name:Apple Watch Series 5 (40mm) }
        { platform:watchOS Simulator, id:66CACF06-A892-4D97-B2DB-4F9E33D2B9B1, OS:9.1, name:Apple Watch Series 5 (40mm) }
        { platform:watchOS Simulator, id:96AAC52C-02B1-4A6D-B500-41D3B501D931, OS:9.0, name:Apple Watch Series 5 (44mm) }
        { platform:watchOS Simulator, id:3FAD648F-8660-4496-93F7-407231A152E0, OS:9.1, name:Apple Watch Series 5 (44mm) }
        { platform:watchOS Simulator, id:F5A1A266-D886-40C1-BC02-13D7EF6D1C85, OS:9.0, name:Apple Watch Series 6 (40mm) }
        { platform:watchOS Simulator, id:6A82988F-EB12-467A-B5C6-3B2A5F5A3363, OS:9.1, name:Apple Watch Series 6 (40mm) }
        { platform:watchOS Simulator, id:EBEEEDEF-EA2B-413A-92B1-B12D5B59D61E, OS:9.0, name:Apple Watch Series 6 (44mm) }
        { platform:watchOS Simulator, id:9D640020-BB34-40B5-B8CE-0EA8319D7FD6, OS:9.1, name:Apple Watch Series 6 (44mm) }
        { platform:watchOS Simulator, id:D87385A1-758A-4D19-8DC0-12E7AB5B607A, OS:9.0, name:Apple Watch Series 7 (41mm) }
        { platform:watchOS Simulator, id:10BC2006-3661-4355-AC01-B506275D7691, OS:9.1, name:Apple Watch Series 7 (41mm) }
        { platform:watchOS Simulator, id:FD9EBD8B-D14A-41E3-9879-935D59284B37, OS:9.0, name:Apple Watch Series 7 (45mm) }
        { platform:watchOS Simulator, id:76D10AAE-2A3B-4E14-A3E7-EDC94F9B1C1C, OS:9.1, name:Apple Watch Series 7 (45mm) }
        { platform:watchOS Simulator, id:F26CFA55-4529-4FE6-931B-5576C53CD5CE, OS:9.0, name:Apple Watch Series 8 (41mm) }
        { platform:watchOS Simulator, id:C0884218-D629-4628-87CF-8F0E97187E88, OS:9.1, name:Apple Watch Series 8 (41mm) }
        { platform:watchOS Simulator, id:99CEC172-171D-4AF7-8B73-7C3DF1F44565, OS:9.0, name:Apple Watch Series 8 (45mm) }
        { platform:watchOS Simulator, id:4B3B2569-A78F-490F-B96D-1EBBAC8D330E, OS:9.1, name:Apple Watch Series 8 (45mm) }
        { platform:watchOS Simulator, id:CC23067F-A844-484B-95CF-D6851403BFB3, OS:9.0, name:Apple Watch Ultra (49mm) }
        { platform:watchOS Simulator, id:99B0FA23-FEB9-4964-8840-5CDBADD60E40, OS:9.1, name:Apple Watch Ultra (49mm) }

Xcode 13: Didn’t show up any watchOS Simulators at all for some reason.

Brett-Best commented 2 years ago

From left to right Xcode 13.4.1, Xcode 14, Xcode 14.1b1

Screen Shot 2022-09-15 at 7 11 01 am
Brett-Best commented 2 years ago

Command ran:

xcrun simctl list | grep atch

Xcode 14.1b1:

Apple Watch (38mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-38mm)
Apple Watch (42mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-42mm)
Apple Watch Series 2 (38mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-2-38mm)
Apple Watch Series 2 (42mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-2-42mm)
Apple Watch Series 3 (38mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-3-38mm)
Apple Watch Series 3 (42mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-3-42mm)
Apple Watch Series 4 (40mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-4-40mm)
Apple Watch Series 4 (44mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-4-44mm)
Apple Watch Series 5 (40mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-5-40mm)
Apple Watch Series 5 (44mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-5-44mm)
Apple Watch SE (40mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-SE-40mm)
Apple Watch SE (44mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-SE-44mm)
Apple Watch Series 6 (40mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-6-40mm)
Apple Watch Series 6 (44mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-6-44mm)
Apple Watch Series 7 (41mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-7-41mm)
Apple Watch Series 7 (45mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-7-45mm)
Apple Watch SE (40mm) (2nd generation) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-SE-44mm-2nd-generation)
Apple Watch SE (44mm) (2nd generation) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-SE-44mm-2nd-generation)
Apple Watch Series 8 (41mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-8-41mm)
Apple Watch Series 8 (45mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-8-45mm)
Apple Watch Ultra (49mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Ultra-49mm)
watchOS 6.0 (6.0 - 17R575) - com.apple.CoreSimulator.SimRuntime.watchOS-6-0
watchOS 9.0 (9.0 - 20R362) - com.apple.CoreSimulator.SimRuntime.watchOS-9-0
watchOS 9.1 (9.1 - 20S5044e) - com.apple.CoreSimulator.SimRuntime.watchOS-9-1
-- watchOS 6.0 --
    Apple Watch Series 4 (40mm) (6C43BF77-A413-45FE-A050-71D7C1A92D3F) (Shutdown) 
    Apple Watch Series 4 (44mm) (C3B4E474-63B9-49EB-92AA-CCAFC62DB39A) (Shutdown) 
    Apple Watch Series 5 (40mm) (379E5367-ED96-41CE-BB38-B828A9D7101A) (Shutdown) 
    Apple Watch Series 5 (44mm) (92EF143A-DD5F-45A0-9D45-EBD21D255DF4) (Shutdown) 
-- watchOS 9.0 --
    Apple Watch Series 5 (40mm) (65E03386-1F57-4E8E-9DB5-49237EE555E6) (Shutdown) 
    Apple Watch Series 5 (44mm) (96AAC52C-02B1-4A6D-B500-41D3B501D931) (Shutdown) 
    Apple Watch Series 6 (40mm) (F5A1A266-D886-40C1-BC02-13D7EF6D1C85) (Shutdown) 
    Apple Watch Series 6 (44mm) (EBEEEDEF-EA2B-413A-92B1-B12D5B59D61E) (Shutdown) 
    Apple Watch Series 7 (41mm) (D87385A1-758A-4D19-8DC0-12E7AB5B607A) (Shutdown) 
    Apple Watch Series 7 (45mm) (FD9EBD8B-D14A-41E3-9879-935D59284B37) (Shutdown) 
    Apple Watch SE (44mm) (2nd generation) (8C9D2FC9-907E-48CD-9FAE-26DD0EF0657A) (Shutdown) 
    Apple Watch Series 8 (41mm) (F26CFA55-4529-4FE6-931B-5576C53CD5CE) (Shutdown) 
    Apple Watch Series 8 (45mm) (99CEC172-171D-4AF7-8B73-7C3DF1F44565) (Shutdown) 
    Apple Watch Ultra (49mm) (CC23067F-A844-484B-95CF-D6851403BFB3) (Shutdown) 
-- watchOS 9.1 --
    Apple Watch Series 5 (40mm) (66CACF06-A892-4D97-B2DB-4F9E33D2B9B1) (Shutdown) 
    Apple Watch Series 5 (44mm) (3FAD648F-8660-4496-93F7-407231A152E0) (Shutdown) 
    Apple Watch Series 6 (40mm) (6A82988F-EB12-467A-B5C6-3B2A5F5A3363) (Shutdown) 
    Apple Watch Series 6 (44mm) (9D640020-BB34-40B5-B8CE-0EA8319D7FD6) (Shutdown) 
    Apple Watch Series 7 (41mm) (10BC2006-3661-4355-AC01-B506275D7691) (Shutdown) 
    Apple Watch Series 7 (45mm) (76D10AAE-2A3B-4E14-A3E7-EDC94F9B1C1C) (Shutdown) 
    Apple Watch SE (40mm) (2nd generation) (E704BAED-FE7B-474C-B913-DCA9998C007F) (Shutdown) 
    Apple Watch Series 8 (41mm) (C0884218-D629-4628-87CF-8F0E97187E88) (Shutdown) 
    Apple Watch Series 8 (45mm) (4B3B2569-A78F-490F-B96D-1EBBAC8D330E) (Shutdown) 
    Apple Watch Ultra (49mm) (99B0FA23-FEB9-4964-8840-5CDBADD60E40) (Shutdown) 
-- Unavailable: com.apple.CoreSimulator.SimRuntime.watchOS-8-5 --
    Apple Watch Series 5 (40mm) (D9DB8066-A05F-4A13-B2B7-3B3A05F616EA) (Shutdown) (unavailable, runtime profile not found)
    Apple Watch Series 5 - 44mm (BADF518E-64CA-437B-B13D-62452458A921) (Shutdown) (unavailable, runtime profile not found)
    Apple Watch Series 6 - 40mm (662FB80C-1D59-4770-9406-9BEBDC4EDFC2) (Shutdown) (unavailable, runtime profile not found)
    Apple Watch Series 6 - 44mm (2F199C7B-F50C-4F6C-B25F-3830974059D4) (Shutdown) (unavailable, runtime profile not found)
    Apple Watch Series 7 (41mm) (4E2E4DB7-4861-4AD5-9096-9EE2DCF17C6E) (Shutdown) (unavailable, runtime profile not found)
    Apple Watch Series 7 (45mm) (0F88F909-803A-4388-BD88-FA2711FCB664) (Shutdown) (unavailable, runtime profile not found)
    Watch: Apple Watch Series 7 (45mm) (FD9EBD8B-D14A-41E3-9879-935D59284B37) (Shutdown)
    Watch: Apple Watch Series 8 (41mm) (F26CFA55-4529-4FE6-931B-5576C53CD5CE) (Shutdown)
    Watch: Apple Watch Series 8 (45mm) (99CEC172-171D-4AF7-8B73-7C3DF1F44565) (Shutdown)
    Watch: Apple Watch Ultra (49mm) (CC23067F-A844-484B-95CF-D6851403BFB3) (Shutdown)
    Watch: Apple Watch Series 7 (45mm) (76D10AAE-2A3B-4E14-A3E7-EDC94F9B1C1C) (Shutdown)
    Watch: Apple Watch Series 8 (41mm) (C0884218-D629-4628-87CF-8F0E97187E88) (Shutdown)
    Watch: Apple Watch Series 8 (45mm) (4B3B2569-A78F-490F-B96D-1EBBAC8D330E) (Shutdown)
    Watch: Apple Watch Ultra (49mm) (99B0FA23-FEB9-4964-8840-5CDBADD60E40) (Shutdown)
    Watch: Apple Watch Series 5 (40mm) (D9DB8066-A05F-4A13-B2B7-3B3A05F616EA) (Shutdown)
    Watch: Apple Watch Series 5 - 44mm (BADF518E-64CA-437B-B13D-62452458A921) (Shutdown)
    Watch: Apple Watch Series 6 - 40mm (662FB80C-1D59-4770-9406-9BEBDC4EDFC2) (Shutdown)
    Watch: Apple Watch Series 6 - 44mm (2F199C7B-F50C-4F6C-B25F-3830974059D4) (Shutdown)
    Watch: Apple Watch Series 7 (41mm) (4E2E4DB7-4861-4AD5-9096-9EE2DCF17C6E) (Shutdown)
    Watch: Apple Watch Series 7 (45mm) (0F88F909-803A-4388-BD88-FA2711FCB664) (Shutdown)

Xcode 14:

Apple Watch (38mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-38mm)
Apple Watch (42mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-42mm)
Apple Watch Series 2 (38mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-2-38mm)
Apple Watch Series 2 (42mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-2-42mm)
Apple Watch Series 3 (38mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-3-38mm)
Apple Watch Series 3 (42mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-3-42mm)
Apple Watch Series 4 (40mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-4-40mm)
Apple Watch Series 4 (44mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-4-44mm)
Apple Watch Series 5 (40mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-5-40mm)
Apple Watch Series 5 (44mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-5-44mm)
Apple Watch SE (40mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-SE-40mm)
Apple Watch SE (44mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-SE-44mm)
Apple Watch Series 6 (40mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-6-40mm)
Apple Watch Series 6 (44mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-6-44mm)
Apple Watch Series 7 (41mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-7-41mm)
Apple Watch Series 7 (45mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-7-45mm)
Apple Watch SE (40mm) (2nd generation) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-SE-44mm-2nd-generation)
Apple Watch SE (44mm) (2nd generation) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-SE-44mm-2nd-generation)
Apple Watch Series 8 (41mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-8-41mm)
Apple Watch Series 8 (45mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-8-45mm)
Apple Watch Ultra (49mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Ultra-49mm)
watchOS 6.0 (6.0 - 17R575) - com.apple.CoreSimulator.SimRuntime.watchOS-6-0
watchOS 9.0 (9.0 - 20R362) - com.apple.CoreSimulator.SimRuntime.watchOS-9-0
watchOS 9.1 (9.1 - 20S5044e) - com.apple.CoreSimulator.SimRuntime.watchOS-9-1
-- watchOS 6.0 --
    Apple Watch Series 4 (40mm) (6C43BF77-A413-45FE-A050-71D7C1A92D3F) (Shutdown) 
    Apple Watch Series 4 (44mm) (C3B4E474-63B9-49EB-92AA-CCAFC62DB39A) (Shutdown) 
    Apple Watch Series 5 (40mm) (379E5367-ED96-41CE-BB38-B828A9D7101A) (Shutdown) 
    Apple Watch Series 5 (44mm) (92EF143A-DD5F-45A0-9D45-EBD21D255DF4) (Shutdown) 
-- watchOS 9.0 --
    Apple Watch Series 5 (40mm) (65E03386-1F57-4E8E-9DB5-49237EE555E6) (Shutdown) 
    Apple Watch Series 5 (44mm) (96AAC52C-02B1-4A6D-B500-41D3B501D931) (Shutdown) 
    Apple Watch Series 6 (40mm) (F5A1A266-D886-40C1-BC02-13D7EF6D1C85) (Shutdown) 
    Apple Watch Series 6 (44mm) (EBEEEDEF-EA2B-413A-92B1-B12D5B59D61E) (Shutdown) 
    Apple Watch Series 7 (41mm) (D87385A1-758A-4D19-8DC0-12E7AB5B607A) (Shutdown) 
    Apple Watch Series 7 (45mm) (FD9EBD8B-D14A-41E3-9879-935D59284B37) (Shutdown) 
    Apple Watch SE (44mm) (2nd generation) (8C9D2FC9-907E-48CD-9FAE-26DD0EF0657A) (Shutdown) 
    Apple Watch Series 8 (41mm) (F26CFA55-4529-4FE6-931B-5576C53CD5CE) (Shutdown) 
    Apple Watch Series 8 (45mm) (99CEC172-171D-4AF7-8B73-7C3DF1F44565) (Shutdown) 
    Apple Watch Ultra (49mm) (CC23067F-A844-484B-95CF-D6851403BFB3) (Shutdown) 
-- watchOS 9.1 --
    Apple Watch Series 5 (40mm) (66CACF06-A892-4D97-B2DB-4F9E33D2B9B1) (Shutdown) 
    Apple Watch Series 5 (44mm) (3FAD648F-8660-4496-93F7-407231A152E0) (Shutdown) 
    Apple Watch Series 6 (40mm) (6A82988F-EB12-467A-B5C6-3B2A5F5A3363) (Shutdown) 
    Apple Watch Series 6 (44mm) (9D640020-BB34-40B5-B8CE-0EA8319D7FD6) (Shutdown) 
    Apple Watch Series 7 (41mm) (10BC2006-3661-4355-AC01-B506275D7691) (Shutdown) 
    Apple Watch Series 7 (45mm) (76D10AAE-2A3B-4E14-A3E7-EDC94F9B1C1C) (Shutdown) 
    Apple Watch SE (40mm) (2nd generation) (E704BAED-FE7B-474C-B913-DCA9998C007F) (Shutdown) 
    Apple Watch Series 8 (41mm) (C0884218-D629-4628-87CF-8F0E97187E88) (Shutdown) 
    Apple Watch Series 8 (45mm) (4B3B2569-A78F-490F-B96D-1EBBAC8D330E) (Shutdown) 
    Apple Watch Ultra (49mm) (99B0FA23-FEB9-4964-8840-5CDBADD60E40) (Shutdown) 
-- Unavailable: com.apple.CoreSimulator.SimRuntime.watchOS-8-5 --
    Apple Watch Series 5 (40mm) (D9DB8066-A05F-4A13-B2B7-3B3A05F616EA) (Shutdown) (unavailable, runtime profile not found)
    Apple Watch Series 5 - 44mm (BADF518E-64CA-437B-B13D-62452458A921) (Shutdown) (unavailable, runtime profile not found)
    Apple Watch Series 6 - 40mm (662FB80C-1D59-4770-9406-9BEBDC4EDFC2) (Shutdown) (unavailable, runtime profile not found)
    Apple Watch Series 6 - 44mm (2F199C7B-F50C-4F6C-B25F-3830974059D4) (Shutdown) (unavailable, runtime profile not found)
    Apple Watch Series 7 (41mm) (4E2E4DB7-4861-4AD5-9096-9EE2DCF17C6E) (Shutdown) (unavailable, runtime profile not found)
    Apple Watch Series 7 (45mm) (0F88F909-803A-4388-BD88-FA2711FCB664) (Shutdown) (unavailable, runtime profile not found)
    Watch: Apple Watch Series 7 (45mm) (FD9EBD8B-D14A-41E3-9879-935D59284B37) (Shutdown)
    Watch: Apple Watch Series 8 (41mm) (F26CFA55-4529-4FE6-931B-5576C53CD5CE) (Shutdown)
    Watch: Apple Watch Series 8 (45mm) (99CEC172-171D-4AF7-8B73-7C3DF1F44565) (Shutdown)
    Watch: Apple Watch Ultra (49mm) (CC23067F-A844-484B-95CF-D6851403BFB3) (Shutdown)
    Watch: Apple Watch Series 7 (45mm) (76D10AAE-2A3B-4E14-A3E7-EDC94F9B1C1C) (Shutdown)
    Watch: Apple Watch Series 8 (41mm) (C0884218-D629-4628-87CF-8F0E97187E88) (Shutdown)
    Watch: Apple Watch Series 8 (45mm) (4B3B2569-A78F-490F-B96D-1EBBAC8D330E) (Shutdown)
    Watch: Apple Watch Ultra (49mm) (99B0FA23-FEB9-4964-8840-5CDBADD60E40) (Shutdown)
    Watch: Apple Watch Series 5 (40mm) (D9DB8066-A05F-4A13-B2B7-3B3A05F616EA) (Shutdown)
    Watch: Apple Watch Series 5 - 44mm (BADF518E-64CA-437B-B13D-62452458A921) (Shutdown)
    Watch: Apple Watch Series 6 - 40mm (662FB80C-1D59-4770-9406-9BEBDC4EDFC2) (Shutdown)
    Watch: Apple Watch Series 6 - 44mm (2F199C7B-F50C-4F6C-B25F-3830974059D4) (Shutdown)
    Watch: Apple Watch Series 7 (41mm) (4E2E4DB7-4861-4AD5-9096-9EE2DCF17C6E) (Shutdown)
    Watch: Apple Watch Series 7 (45mm) (0F88F909-803A-4388-BD88-FA2711FCB664) (Shutdown)

Xcode 13.4.1:

Apple Watch - 38mm (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-38mm)
Apple Watch - 42mm (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-42mm)
Apple Watch Series 2 - 38mm (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-2-38mm)
Apple Watch Series 2 - 42mm (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-2-42mm)
Apple Watch Series 3 - 38mm (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-3-38mm)
Apple Watch Series 3 - 42mm (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-3-42mm)
Apple Watch Series 4 - 40mm (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-4-40mm)
Apple Watch Series 4 - 44mm (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-4-44mm)
Apple Watch Series 5 - 40mm (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-5-40mm)
Apple Watch Series 5 - 44mm (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-5-44mm)
Apple Watch SE - 40mm (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-SE-40mm)
Apple Watch SE - 44mm (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-SE-44mm)
Apple Watch Series 6 - 40mm (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-6-40mm)
Apple Watch Series 6 - 44mm (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-6-44mm)
Apple Watch Series 7 - 41mm (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-7-41mm)
Apple Watch Series 7 - 45mm (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-7-45mm)
watchOS 6.0 (6.0 - 17R575) - com.apple.CoreSimulator.SimRuntime.watchOS-6-0
watchOS 8.5 (8.5 - 19T241) - com.apple.CoreSimulator.SimRuntime.watchOS-8-5
watchOS 9.0 (9.0 - 20R362) - com.apple.CoreSimulator.SimRuntime.watchOS-9-0
watchOS 9.1 (9.1 - 20S5044e) - com.apple.CoreSimulator.SimRuntime.watchOS-9-1
-- watchOS 6.0 --
    Apple Watch Series 4 (40mm) (6C43BF77-A413-45FE-A050-71D7C1A92D3F) (Shutdown) 
    Apple Watch Series 4 (44mm) (C3B4E474-63B9-49EB-92AA-CCAFC62DB39A) (Shutdown) 
    Apple Watch Series 5 (40mm) (379E5367-ED96-41CE-BB38-B828A9D7101A) (Shutdown) 
    Apple Watch Series 5 (44mm) (92EF143A-DD5F-45A0-9D45-EBD21D255DF4) (Shutdown) 
-- watchOS 8.5 --
    Apple Watch Series 5 (40mm) (D9DB8066-A05F-4A13-B2B7-3B3A05F616EA) (Shutdown) 
    Apple Watch Series 5 - 44mm (BADF518E-64CA-437B-B13D-62452458A921) (Shutdown) 
    Apple Watch Series 6 - 40mm (662FB80C-1D59-4770-9406-9BEBDC4EDFC2) (Shutdown) 
    Apple Watch Series 6 - 44mm (2F199C7B-F50C-4F6C-B25F-3830974059D4) (Shutdown) 
    Apple Watch Series 7 (41mm) (4E2E4DB7-4861-4AD5-9096-9EE2DCF17C6E) (Shutdown) 
    Apple Watch Series 7 (45mm) (0F88F909-803A-4388-BD88-FA2711FCB664) (Shutdown) 
-- watchOS 9.0 --
    Apple Watch Series 5 (40mm) (65E03386-1F57-4E8E-9DB5-49237EE555E6) (Shutdown) 
    Apple Watch Series 5 (44mm) (96AAC52C-02B1-4A6D-B500-41D3B501D931) (Shutdown) 
    Apple Watch Series 6 (40mm) (F5A1A266-D886-40C1-BC02-13D7EF6D1C85) (Shutdown) 
    Apple Watch Series 6 (44mm) (EBEEEDEF-EA2B-413A-92B1-B12D5B59D61E) (Shutdown) 
    Apple Watch Series 7 (41mm) (D87385A1-758A-4D19-8DC0-12E7AB5B607A) (Shutdown) 
    Apple Watch Series 7 (45mm) (FD9EBD8B-D14A-41E3-9879-935D59284B37) (Shutdown) 
    Apple Watch SE (44mm) (2nd generation) (8C9D2FC9-907E-48CD-9FAE-26DD0EF0657A) (Shutdown) (unavailable, device type profile not found)
    Apple Watch Series 8 (41mm) (F26CFA55-4529-4FE6-931B-5576C53CD5CE) (Shutdown) (unavailable, device type profile not found)
    Apple Watch Series 8 (45mm) (99CEC172-171D-4AF7-8B73-7C3DF1F44565) (Shutdown) (unavailable, device type profile not found)
    Apple Watch Ultra (49mm) (CC23067F-A844-484B-95CF-D6851403BFB3) (Shutdown) (unavailable, device type profile not found)
-- watchOS 9.1 --
    Apple Watch Series 5 (40mm) (66CACF06-A892-4D97-B2DB-4F9E33D2B9B1) (Shutdown) 
    Apple Watch Series 5 (44mm) (3FAD648F-8660-4496-93F7-407231A152E0) (Shutdown) 
    Apple Watch Series 6 (40mm) (6A82988F-EB12-467A-B5C6-3B2A5F5A3363) (Shutdown) 
    Apple Watch Series 6 (44mm) (9D640020-BB34-40B5-B8CE-0EA8319D7FD6) (Shutdown) 
    Apple Watch Series 7 (41mm) (10BC2006-3661-4355-AC01-B506275D7691) (Shutdown) 
    Apple Watch Series 7 (45mm) (76D10AAE-2A3B-4E14-A3E7-EDC94F9B1C1C) (Shutdown) 
    Apple Watch SE (40mm) (2nd generation) (E704BAED-FE7B-474C-B913-DCA9998C007F) (Shutdown) (unavailable, device type profile not found)
    Apple Watch Series 8 (41mm) (C0884218-D629-4628-87CF-8F0E97187E88) (Shutdown) (unavailable, device type profile not found)
    Apple Watch Series 8 (45mm) (4B3B2569-A78F-490F-B96D-1EBBAC8D330E) (Shutdown) (unavailable, device type profile not found)
    Apple Watch Ultra (49mm) (99B0FA23-FEB9-4964-8840-5CDBADD60E40) (Shutdown) (unavailable, device type profile not found)
    Watch: Apple Watch Series 5 (40mm) (D9DB8066-A05F-4A13-B2B7-3B3A05F616EA) (Shutdown)
    Watch: Apple Watch Series 5 - 44mm (BADF518E-64CA-437B-B13D-62452458A921) (Shutdown)
    Watch: Apple Watch Series 6 - 40mm (662FB80C-1D59-4770-9406-9BEBDC4EDFC2) (Shutdown)
    Watch: Apple Watch Series 6 - 44mm (2F199C7B-F50C-4F6C-B25F-3830974059D4) (Shutdown)
    Watch: Apple Watch Series 7 (41mm) (4E2E4DB7-4861-4AD5-9096-9EE2DCF17C6E) (Shutdown)
    Watch: Apple Watch Series 7 (45mm) (0F88F909-803A-4388-BD88-FA2711FCB664) (Shutdown)
    Watch: Apple Watch Series 7 (45mm) (FD9EBD8B-D14A-41E3-9879-935D59284B37) (Shutdown)
    Watch: Apple Watch Series 8 (41mm) (F26CFA55-4529-4FE6-931B-5576C53CD5CE) (Shutdown)
    Watch: Apple Watch Series 8 (45mm) (99CEC172-171D-4AF7-8B73-7C3DF1F44565) (Shutdown)
    Watch: Apple Watch Ultra (49mm) (CC23067F-A844-484B-95CF-D6851403BFB3) (Shutdown)
    Watch: Apple Watch Series 7 (45mm) (76D10AAE-2A3B-4E14-A3E7-EDC94F9B1C1C) (Shutdown)
    Watch: Apple Watch Series 8 (41mm) (C0884218-D629-4628-87CF-8F0E97187E88) (Shutdown)
    Watch: Apple Watch Series 8 (45mm) (4B3B2569-A78F-490F-B96D-1EBBAC8D330E) (Shutdown)
    Watch: Apple Watch Ultra (49mm) (99B0FA23-FEB9-4964-8840-5CDBADD60E40) (Shutdown)
Brett-Best commented 2 years ago

Doing the above same steps but getting rid of the simulator devices between opening up each Xcode version which recreates them.

  1. Quit all Xcodes, run rm -rf ~/Library/Developer/CoreSimulator/Devices
  2. Run killall -9 com.apple.CoreSimulator.CoreSimulatorService
  3. Open up an Xcode version
  4. Run xcrun simctl list | grep atch

Xcode 14.1b1:

Apple Watch (38mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-38mm)
Apple Watch (42mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-42mm)
Apple Watch Series 2 (38mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-2-38mm)
Apple Watch Series 2 (42mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-2-42mm)
Apple Watch Series 3 (38mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-3-38mm)
Apple Watch Series 3 (42mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-3-42mm)
Apple Watch Series 4 (40mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-4-40mm)
Apple Watch Series 4 (44mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-4-44mm)
Apple Watch Series 5 (40mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-5-40mm)
Apple Watch Series 5 (44mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-5-44mm)
Apple Watch SE (40mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-SE-40mm)
Apple Watch SE (44mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-SE-44mm)
Apple Watch Series 6 (40mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-6-40mm)
Apple Watch Series 6 (44mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-6-44mm)
Apple Watch Series 7 (41mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-7-41mm)
Apple Watch Series 7 (45mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-7-45mm)
Apple Watch SE (40mm) (2nd generation) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-SE-44mm-2nd-generation)
Apple Watch SE (44mm) (2nd generation) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-SE-44mm-2nd-generation)
Apple Watch Series 8 (41mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-8-41mm)
Apple Watch Series 8 (45mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-8-45mm)
Apple Watch Ultra (49mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Ultra-49mm)
watchOS 6.0 (6.0 - 17R575) - com.apple.CoreSimulator.SimRuntime.watchOS-6-0
watchOS 9.0 (9.0 - 20R362) - com.apple.CoreSimulator.SimRuntime.watchOS-9-0
watchOS 9.1 (9.1 - 20S5044e) - com.apple.CoreSimulator.SimRuntime.watchOS-9-1
-- watchOS 6.0 --
    Apple Watch Series 4 (40mm) (A8883022-62ED-4442-A8C1-76F1507140E6) (Shutdown) 
    Apple Watch Series 4 (44mm) (57191080-C10E-40C1-A33C-7A5D96310F9C) (Shutdown) 
    Apple Watch Series 5 (40mm) (6702CC7F-0340-4F5A-8D7E-7D2A43C04318) (Shutdown) 
    Apple Watch Series 5 (44mm) (8E64A4FA-7003-4FF3-8F2B-DE91A67D2ABF) (Shutdown) 
-- watchOS 9.0 --
    Apple Watch Series 5 (40mm) (036F2068-FA81-4A99-AA05-BE87098B0FE9) (Shutdown) 
    Apple Watch Series 5 (44mm) (63AA3215-D8D8-48CF-AB86-FCD3B748650B) (Shutdown) 
    Apple Watch Series 6 (40mm) (83146006-5B1D-4740-90BC-8CB4D90A9DC2) (Shutdown) 
    Apple Watch Series 6 (44mm) (4AD5807D-CB9F-4D40-8B60-1AE7C6C6D99B) (Shutdown) 
    Apple Watch Series 7 (41mm) (E52F1922-CD55-4E1E-8E21-C3E16A3B59E7) (Shutdown) 
    Apple Watch Series 7 (45mm) (85C56002-A24E-47DA-9C89-77C0D262FC7C) (Shutdown) 
    Apple Watch SE (44mm) (2nd generation) (CD6EA942-046D-43B3-AE34-840CAE83C2DB) (Shutdown) 
    Apple Watch Series 8 (41mm) (BCA84909-03A8-4412-8364-8B0FA4FE3C4D) (Shutdown) 
    Apple Watch Series 8 (45mm) (4B8282BC-C163-4F91-935C-0C0F5910E4BC) (Shutdown) 
    Apple Watch Ultra (49mm) (F4841D17-2BD2-44C2-90E6-D09BC3BF5835) (Shutdown) 
-- watchOS 9.1 --
    Apple Watch Series 5 (40mm) (684AE67C-E9F0-4B9E-8D4F-FF7720E58793) (Shutdown) 
    Apple Watch Series 5 (44mm) (9D73792A-8FF1-49C1-84D8-C49A5041C9A2) (Shutdown) 
    Apple Watch Series 6 (40mm) (26D5523A-95D2-443E-A24D-3E64A42BDB86) (Shutdown) 
    Apple Watch Series 6 (44mm) (CFA6A119-7393-410E-BEAD-E9281998BAFB) (Shutdown) 
    Apple Watch Series 7 (41mm) (17205AE9-07DE-42B9-BED2-89ED542223E4) (Shutdown) 
    Apple Watch Series 7 (45mm) (7458735B-0D8B-4FE2-A7D2-4F147F50C193) (Shutdown) 
    Apple Watch SE (44mm) (2nd generation) (5490F486-7917-4E1D-B298-368BD0F0BEEE) (Shutdown) 
    Apple Watch Series 8 (41mm) (496DE80B-4654-437F-B1F4-C0F3B8E69D16) (Shutdown) 
    Apple Watch Series 8 (45mm) (A7B1BB4E-5DC3-4E0D-8E14-14B75C3C84AC) (Shutdown) 
    Apple Watch Ultra (49mm) (36C85100-163D-4580-8727-94CB17F6DC94) (Shutdown) 
    Watch: Apple Watch Series 7 (45mm) (7458735B-0D8B-4FE2-A7D2-4F147F50C193) (Shutdown)
    Watch: Apple Watch Series 8 (41mm) (496DE80B-4654-437F-B1F4-C0F3B8E69D16) (Shutdown)
    Watch: Apple Watch Series 8 (45mm) (A7B1BB4E-5DC3-4E0D-8E14-14B75C3C84AC) (Shutdown)
    Watch: Apple Watch Ultra (49mm) (36C85100-163D-4580-8727-94CB17F6DC94) (Shutdown)

Xcode 14:

Apple Watch (38mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-38mm)
Apple Watch (42mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-42mm)
Apple Watch Series 2 (38mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-2-38mm)
Apple Watch Series 2 (42mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-2-42mm)
Apple Watch Series 3 (38mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-3-38mm)
Apple Watch Series 3 (42mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-3-42mm)
Apple Watch Series 4 (40mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-4-40mm)
Apple Watch Series 4 (44mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-4-44mm)
Apple Watch Series 5 (40mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-5-40mm)
Apple Watch Series 5 (44mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-5-44mm)
Apple Watch SE (40mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-SE-40mm)
Apple Watch SE (44mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-SE-44mm)
Apple Watch Series 6 (40mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-6-40mm)
Apple Watch Series 6 (44mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-6-44mm)
Apple Watch Series 7 (41mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-7-41mm)
Apple Watch Series 7 (45mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-7-45mm)
Apple Watch SE (40mm) (2nd generation) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-SE-44mm-2nd-generation)
Apple Watch SE (44mm) (2nd generation) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-SE-44mm-2nd-generation)
Apple Watch Series 8 (41mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-8-41mm)
Apple Watch Series 8 (45mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-8-45mm)
Apple Watch Ultra (49mm) (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Ultra-49mm)
watchOS 6.0 (6.0 - 17R575) - com.apple.CoreSimulator.SimRuntime.watchOS-6-0
watchOS 9.0 (9.0 - 20R362) - com.apple.CoreSimulator.SimRuntime.watchOS-9-0
watchOS 9.1 (9.1 - 20S5044e) - com.apple.CoreSimulator.SimRuntime.watchOS-9-1
-- watchOS 6.0 --
    Apple Watch Series 4 (40mm) (1A67DAEB-677A-4889-9041-3D6D5996D36C) (Shutdown) 
    Apple Watch Series 4 (44mm) (8C879F38-8186-4FD8-B71E-A4B6A1CEBBAC) (Shutdown) 
    Apple Watch Series 5 (40mm) (46BD081E-B7F2-490C-B7DA-BD4DF94610FD) (Shutdown) 
    Apple Watch Series 5 (44mm) (D82A0A24-B943-4659-BE23-CFD8CD4227FA) (Shutdown) 
-- watchOS 9.0 --
    Apple Watch Series 5 (40mm) (DF6908F6-42C7-4680-80AD-8794841967D3) (Shutdown) 
    Apple Watch Series 5 (44mm) (D4F6B3B8-47B6-41B0-B8B0-3D5B4FEF1CC2) (Shutdown) 
    Apple Watch Series 6 (40mm) (7116D85A-238D-40E5-BF08-4BBEA09C86F8) (Shutdown) 
    Apple Watch Series 6 (44mm) (E655BC6D-1940-45E4-BF3D-CACC413D957F) (Shutdown) 
    Apple Watch Series 7 (41mm) (08F9A6D1-5211-45AF-A006-6126BAD83A58) (Shutdown) 
    Apple Watch Series 7 (45mm) (C268ACF2-F9AC-469F-A652-31FF4FCEEAC1) (Shutdown) 
    Apple Watch SE (44mm) (2nd generation) (88B0EECA-BDD7-4209-81CB-68D72B159B45) (Shutdown) 
    Apple Watch Series 8 (41mm) (2BA90F12-FD6A-4CFB-84D6-1B97B816CC52) (Shutdown) 
    Apple Watch Series 8 (45mm) (5E2E7DD3-CB28-4107-9797-2BABD948F3F8) (Shutdown) 
    Apple Watch Ultra (49mm) (690BDE37-3C68-42FC-9630-225D7F6D76FD) (Shutdown) 
-- watchOS 9.1 --
    Apple Watch Series 5 (40mm) (9687DE67-4DF2-4664-B669-38DDE88E6592) (Shutdown) 
    Apple Watch Series 5 (44mm) (2140503E-BBE4-4E8B-921F-22B7FD5E1C9D) (Shutdown) 
    Apple Watch Series 6 (40mm) (24838FDD-461C-488E-A996-FB101CB587AD) (Shutdown) 
    Apple Watch Series 6 (44mm) (9865FBC7-7A2C-404A-AA5A-18921E1F30B8) (Shutdown) 
    Apple Watch Series 7 (41mm) (F39349BB-BE60-4918-8A44-53F0BBDDF0FE) (Shutdown) 
    Apple Watch Series 7 (45mm) (46B96C6C-66FC-4A3F-B784-9008604D8A0F) (Shutdown) 
    Apple Watch SE (44mm) (2nd generation) (3D282FC3-3B84-4BDD-8D87-C987D42DE505) (Shutdown) 
    Apple Watch Series 8 (41mm) (0EEE0ADF-FE9E-4DE0-B838-FB0EE58A515E) (Shutdown) 
    Apple Watch Series 8 (45mm) (6C5E6FDF-E2F7-4245-8467-61F1C12144A1) (Shutdown) 
    Apple Watch Ultra (49mm) (07E721FF-8138-4675-AAFA-4097949D9011) (Shutdown) 
    Watch: Apple Watch Series 7 (45mm) (C268ACF2-F9AC-469F-A652-31FF4FCEEAC1) (Shutdown)
    Watch: Apple Watch Series 8 (41mm) (2BA90F12-FD6A-4CFB-84D6-1B97B816CC52) (Shutdown)
    Watch: Apple Watch Series 8 (45mm) (5E2E7DD3-CB28-4107-9797-2BABD948F3F8) (Shutdown)
    Watch: Apple Watch Ultra (49mm) (690BDE37-3C68-42FC-9630-225D7F6D76FD) (Shutdown)

Xcode 13.4.1:

Apple Watch - 38mm (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-38mm)
Apple Watch - 42mm (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-42mm)
Apple Watch Series 2 - 38mm (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-2-38mm)
Apple Watch Series 2 - 42mm (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-2-42mm)
Apple Watch Series 3 - 38mm (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-3-38mm)
Apple Watch Series 3 - 42mm (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-3-42mm)
Apple Watch Series 4 - 40mm (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-4-40mm)
Apple Watch Series 4 - 44mm (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-4-44mm)
Apple Watch Series 5 - 40mm (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-5-40mm)
Apple Watch Series 5 - 44mm (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-5-44mm)
Apple Watch SE - 40mm (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-SE-40mm)
Apple Watch SE - 44mm (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-SE-44mm)
Apple Watch Series 6 - 40mm (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-6-40mm)
Apple Watch Series 6 - 44mm (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-6-44mm)
Apple Watch Series 7 - 41mm (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-7-41mm)
Apple Watch Series 7 - 45mm (com.apple.CoreSimulator.SimDeviceType.Apple-Watch-Series-7-45mm)
watchOS 6.0 (6.0 - 17R575) - com.apple.CoreSimulator.SimRuntime.watchOS-6-0
watchOS 8.5 (8.5 - 19T241) - com.apple.CoreSimulator.SimRuntime.watchOS-8-5
watchOS 9.0 (9.0 - 20R362) - com.apple.CoreSimulator.SimRuntime.watchOS-9-0
watchOS 9.1 (9.1 - 20S5044e) - com.apple.CoreSimulator.SimRuntime.watchOS-9-1
-- watchOS 6.0 --
    Apple Watch Series 4 - 40mm (73FF520B-075A-4768-A61C-54387522663D) (Shutdown) 
    Apple Watch Series 4 - 44mm (A8326122-B1A8-4486-AB33-674DDA6DB407) (Shutdown) 
    Apple Watch Series 5 - 40mm (7D304B26-16A3-4777-B391-313310DB3FB1) (Shutdown) 
    Apple Watch Series 5 - 44mm (61B81773-876D-49FE-98D3-9AE5ACE94143) (Shutdown) 
-- watchOS 8.5 --
    Apple Watch Series 5 - 40mm (79D10463-8493-45C0-BFB3-9852E02CA67F) (Shutdown) 
    Apple Watch Series 5 - 44mm (479F0EC0-C01B-41FF-9168-0EF68AFC4D28) (Shutdown) 
    Apple Watch Series 6 - 40mm (4E611A4C-F4C7-46D6-921A-ECFA9D95B35B) (Shutdown) 
    Apple Watch Series 6 - 44mm (F869279B-CC19-4632-A38F-5F62F6434733) (Shutdown) 
    Apple Watch Series 7 - 41mm (D1A935DD-DBBF-4E6A-80EF-51BCEB3F8482) (Shutdown) 
    Apple Watch Series 7 - 45mm (1A6DE8D0-C0AF-40E1-9EF8-EC78973FE6EC) (Shutdown) 
-- watchOS 9.0 --
    Apple Watch Series 5 - 40mm (5E83A8DE-CFF1-4D5B-8978-11D494D6F873) (Shutdown) 
    Apple Watch Series 5 - 44mm (8D9471F5-F10B-46D3-A17D-2F7FCA74586F) (Shutdown) 
    Apple Watch Series 6 - 40mm (569CE508-8DDA-48B3-9762-2E57E38DC95A) (Shutdown) 
    Apple Watch Series 6 - 44mm (51A9677D-5134-44ED-9FC3-1CDC1BB3C177) (Shutdown) 
    Apple Watch Series 7 - 41mm (5423B586-E78B-4B8A-92FA-590AA191B0B8) (Shutdown) 
    Apple Watch Series 7 - 45mm (893E54BF-5CBC-41E8-851E-C069772328F7) (Shutdown) 
-- watchOS 9.1 --
    Apple Watch Series 5 - 40mm (C666E6EC-DFA4-4F08-98CB-CFD18B37CC80) (Shutdown) 
    Apple Watch Series 5 - 44mm (1CFB1178-42F6-4056-86FA-8452F8914937) (Shutdown) 
    Apple Watch Series 6 - 40mm (7043609B-046E-4174-875B-A0A9AF242C03) (Shutdown) 
    Apple Watch Series 6 - 44mm (4A269DB4-D3AF-4C8E-947B-6FBB83217339) (Shutdown) 
    Apple Watch Series 7 - 41mm (E4CB746C-A84E-4091-B8F6-AF060C2B94AB) (Shutdown) 
    Apple Watch Series 7 - 45mm (F2ED42E4-AB76-4F3C-A381-E10A3229F0DE) (Shutdown) 
    Watch: Apple Watch Series 5 - 40mm (79D10463-8493-45C0-BFB3-9852E02CA67F) (Shutdown)
    Watch: Apple Watch Series 5 - 44mm (479F0EC0-C01B-41FF-9168-0EF68AFC4D28) (Shutdown)
    Watch: Apple Watch Series 6 - 40mm (4E611A4C-F4C7-46D6-921A-ECFA9D95B35B) (Shutdown)
    Watch: Apple Watch Series 6 - 44mm (F869279B-CC19-4632-A38F-5F62F6434733) (Shutdown)
    Watch: Apple Watch Series 7 - 41mm (D1A935DD-DBBF-4E6A-80EF-51BCEB3F8482) (Shutdown)
    Watch: Apple Watch Series 7 - 45mm (1A6DE8D0-C0AF-40E1-9EF8-EC78973FE6EC) (Shutdown)
Brett-Best commented 2 years ago

@bdrelling I’m going to take a guess that the reason you were getting the inconsistency in the naming is due to different versions of Xcode not recreating already existent simulators for the same device.

If you try the steps in the last comment above, does it make the naming consistent for you on your local machine?

bdrelling commented 2 years ago

@Brett-Best Thanks for all this output of information! I had a hard time collecting it myself, as I only have the GitHub Actions runners for output currently.

I think what we're seeing in your snippets above, if I'm understanding correctly, is the same thing I'm seeing locally:

Xcode 12, 13, and 14 (via UI) all install simulators with one naming convention. Xcode 14 (via CLI) installs simulators with another naming convention.

I think I could fix this for my local machine, definitely, but I'm not sure if you're just asking me to check or if you're proposing it as a solution? If the latter, I don't think it will work as a solution because (a) I would hazard a guess that the vast, vast majority of developers working with Xcode installed via the UI prompt, and (b) there'd still be the problem of Xcode 12/13 and Xcode 14 having different simulators names for the same device on GitHub Actions.

Just to provide an example for the issue: if I have a workflow defined to run the following script, it will run successfully on macos-12' installed Xcode 13.x, but fail on Xcode 14.x.

xcodebuild clean build -scheme MyScheme -destination 'platform=watchOS Simulator,name=Apple Watch Series 6 - 44mm'

I definitely think this is an Apple-caused problem to be clear (by not validating that simulators installed via CLI have the same names as Xcode), but I think the Xcode 14.x simulators on macos-12 should be normalized to match Xcode 12, Xcode 13, and Xcode 14 (via UI).

Sorry if I just restated a bunch of stuff -- just trying to make sure the issue is clear!

Brett-Best commented 2 years ago

Can’t test Xcode 12.

Xcode 12, 13, and 14 (via UI) all install simulators with one naming convention.

No, Xcode 13 and 14 have different naming conventions - see the screenshots for confirmation

Xcode 14 (via CLI) installs simulators with another naming convention.

Usage in Xcode and within the CLI have the same naming convention. Doesn’t matter if the simulator runtime was installed using the UI or the xcodebuild command that downloads them.

The issue you have with the inconsistencies is because Xcode won’t recreate simulators if they already exist, if you follow the steps to remove all the existing devices and then get each Xcode version to generate the default set again you’ll find that Xcode 13 uses - and Xcode 14 uses ( ).

bdrelling commented 2 years ago

No, Xcode 13 and 14 have different naming conventions - see the screenshots for confirmation

Got it, I'm understanding what you're saying now.

I was positive I confirmed this in the other thread, but it's possible I didn't have a clean install because I didn't properly remove Xcode's tools when testing it.

Definitely frustrating that Apple did this, especially given that it'll break so much more (like SwiftUI previews, which are still hardcoded values), but I don't think GitHub should change anything here, as I should expect Xcode 14 to be the same locally or remotely and not adjusted to match older versions.

Thanks again for digging into this so much, appreciate the diligence! Feel free to close this.