Unable to run on macOS GitHub runner with brew installation

undergroundwires commented 2 months ago

Description

First of all, thank you for building and maintaining this project. I've been using it has been successfully empowering CI/CD builds for privacy.sexy and private mac computers.

This has been working without any issues, but the CI/CD workflows started failing since last week.

This is step that's failing:

brew install docker
brew install colima
colima start

See related source code.

Version

I cannot run the command as this runs in GitHub CI/CD runners, but parsing the logs I find out that:

colima: ==> Pouring colima--0.6.8.arm64_sonoma.bottle.tar.gz
lima: ==> Pouring lima--0.21.0.arm64_sonoma.bottle.tar.gz
qemu: ==> Pouring qemu--8.2.2.arm64_sonoma.bottle.tar.gz

Operating System

[ ] macOS Intel <= 13 (Ventura)
[ ] macOS Intel >= 14 (Sonoma)
[ ] Apple Silicon <= 13 (Ventura)
[x] Apple Silicon >= 14 (Sonoma)
[ ] Linux

Additional context

Logs:

==> Fetching colima
==> Downloading https://ghcr.io/v2/homebrew/core/colima/blobs/sha256:69af395c2207b9e0b9c917cdff036b3e2b968053a1a8b697cccb0bc6a59f66b6
==> Installing dependencies for colima: capstone, dtc, libslirp, libssh, ncurses, snappy, vde, qemu and lima
==> Installing colima dependency: capstone
==> Downloading https://ghcr.io/v2/homebrew/core/capstone/manifests/5.0.1
Already downloaded: /Users/runner/Library/Caches/Homebrew/downloads/eb17389103bcda1a9712be38238eb72e8056accea2c41fe32618aada1d7e1d79--capstone-5.0.1.bottle_manifest.json
==> Pouring capstone--5.0.1.arm64_sonoma.bottle.tar.gz
🍺  /opt/homebrew/Cellar/capstone/5.0.1: 30 files, 22.3MB
==> Installing colima dependency: dtc
==> Downloading https://ghcr.io/v2/homebrew/core/dtc/manifests/1.7.0
Already downloaded: /Users/runner/Library/Caches/Homebrew/downloads/00668efdbca5875f420621ff3011ae53448a6324636c2a27fe2323933c1ef3fa--dtc-1.7.0.bottle_manifest.json
==> Pouring dtc--1.7.0.arm64_sonoma.bottle.tar.gz
🍺  /opt/homebrew/Cellar/dtc/1.7.0: 18 files, 619.6KB
==> Installing colima dependency: libslirp
==> Downloading https://ghcr.io/v2/homebrew/core/libslirp/manifests/4.7.0
Already downloaded: /Users/runner/Library/Caches/Homebrew/downloads/d8b5de971474690b01b484c84652c487b14a22eded9d5b91cecae2995692c598--libslirp-4.7.0.bottle_manifest.json
==> Pouring libslirp--4.7.0.arm64_sonoma.bottle.tar.gz
🍺  /opt/homebrew/Cellar/libslirp/4.7.0: 11 files, 387.3KB
==> Installing colima dependency: libssh
==> Downloading https://ghcr.io/v2/homebrew/core/libssh/manifests/0.10.6
Already downloaded: /Users/runner/Library/Caches/Homebrew/downloads/a4ff6d890d834da2f865bf30651aa0ed1423be8e2684d4586895f1d9c887449b--libssh-0.10.6.bottle_manifest.json
==> Pouring libssh--0.10.6.arm64_sonoma.bottle.tar.gz
🍺  /opt/homebrew/Cellar/libssh/0.10.6: 23 files, 1.3MB
==> Installing colima dependency: ncurses
==> Downloading https://ghcr.io/v2/homebrew/core/ncurses/manifests/6.4-1
Already downloaded: /Users/runner/Library/Caches/Homebrew/downloads/548168356558130632a3202b3fc2f3069f554bd5c1010b30e61f1180cf1f6b09--ncurses-6.4-1.bottle_manifest.json
==> Pouring ncurses--6.4.arm64_sonoma.bottle.1.tar.gz
🍺  /opt/homebrew/Cellar/ncurses/6.4: 4,001 files, 9.7MB
==> Installing colima dependency: snappy
==> Downloading https://ghcr.io/v2/homebrew/core/snappy/manifests/1.1.10
Already downloaded: /Users/runner/Library/Caches/Homebrew/downloads/66500196008160ff18d67179e002e417a71c59707d74a6706c2e89a8aa2411b8--snappy-1.1.10.bottle_manifest.json
==> Pouring snappy--1.1.10.arm64_sonoma.bottle.tar.gz
🍺  /opt/homebrew/Cellar/snappy/1.1.10: 18 files, 164.6KB
==> Installing colima dependency: vde
==> Downloading https://ghcr.io/v2/homebrew/core/vde/manifests/2.3.3
Already downloaded: /Users/runner/Library/Caches/Homebrew/downloads/4e9503141162571c2cd21e89a9e61f524a7403ffe5ffe269f4a39ce5aef9f210--vde-2.3.3.bottle_manifest.json
==> Pouring vde--2.3.3.arm64_sonoma.bottle.tar.gz
🍺  /opt/homebrew/Cellar/vde/2.3.3: 66 files, 1.3MB
==> Installing colima dependency: qemu
==> Downloading https://ghcr.io/v2/homebrew/core/qemu/manifests/8.2.2
Already downloaded: /Users/runner/Library/Caches/Homebrew/downloads/c681de3cfaf9aab96d9ea8dd837fe86e28c5191bfccc9068792ed8cd3a18f237--qemu-8.2.2.bottle_manifest.json
==> Pouring qemu--8.2.2.arm64_sonoma.bottle.tar.gz
🍺  /opt/homebrew/Cellar/qemu/8.2.2: 162 files, 562.0MB
==> Installing colima dependency: lima
==> Downloading https://ghcr.io/v2/homebrew/core/lima/manifests/0.21.0
Already downloaded: /Users/runner/Library/Caches/Homebrew/downloads/3902e93ee213e42997af864ec73a19fb8f9d5cab76f87474a24f4f1d3986e784--lima-0.21.0.bottle_manifest.json
==> Pouring lima--0.21.0.arm64_sonoma.bottle.tar.gz
🍺  /opt/homebrew/Cellar/lima/0.21.0: 108 files, 175.6MB
==> Installing colima
==> Pouring colima--0.6.8.arm64_sonoma.bottle.tar.gz
==> Caveats
Bash completion has been installed to:
  /opt/homebrew/etc/bash_completion.d

To start colima now and restart at login:
  brew services start colima
Or, if you don't want/need a background service you can just run:
  /opt/homebrew/opt/colima/bin/colima start -f
==> Summary
🍺  /opt/homebrew/Cellar/colima/0.6.8: 10 files, 5.7MB
==> Caveats
==> colima
Bash completion has been installed to:
  /opt/homebrew/etc/bash_completion.d

To start colima now and restart at login:
  brew services start colima
Or, if you don't want/need a background service you can just run:
  /opt/homebrew/opt/colima/bin/colima start -f
time="2024-05-04T10:11:45Z" level=info msg="starting colima"
time="2024-05-04T10:11:45Z" level=info msg="runtime: docker"
time="2024-05-04T10:11:46Z" level=info msg="creating and starting ..." context=vm
time="2024-05-04T10:11:46Z" level=info msg="Terminal is not available, proceeding without opening an editor"
time="2024-05-04T10:11:47Z" level=info msg="Starting the instance \"colima\" with VM driver \"qemu\""
time="2024-05-04T10:11:47Z" level=info msg="QEMU binary \"/opt/homebrew/bin/qemu-system-aarch64\" seems properly signed with the \"com.apple.security.hypervisor\" entitlement"
time="2024-05-04T10:11:47Z" level=info msg="Attempting to download the image" arch=aarch64 digest="sha512:00e3339bdebd98c3e003570ffb3ad4b01630fe4fcecd15061d5d58e14c07b211c718ed20fa3e4cce227d3b1c59fd98241eaa3e9e2cdfa04acfe32b4bc385428c" location="https://github.com/abiosoft/colima-core/releases/download/v0.6.8-2/ubuntu-23.10-minimal-cloudimg-arm64.qcow2"
Downloading the image (ubuntu-23.10-minimal-cloudimg-arm64.qcow2)

315.51 MiB / 405.01 MiB (77.90%) ? p/s
405.01 MiB / 405.01 MiB (100.00%) 279.33 MiB/stime="2024-05-04T10:11:54Z" level=info msg="Downloaded the image from \"[https://github.com/abiosoft/colima-core/releases/download/v0.6.8-2/ubuntu-23.10-minimal-cloudimg-arm64.qcow2\](https://github.com/abiosoft/colima-core/releases/download/v0.6.8-2/ubuntu-23.10-minimal-cloudimg-arm64.qcow2/)""
time="2024-05-04T10:11:54Z" level=info msg="[hostagent] hostagent socket created at /Users/runner/.colima/_lima/colima/ha.sock"
time="2024-05-04T10:11:54Z" level=info msg="[hostagent] Using system firmware (\"/opt/homebrew/share/qemu/edk2-aarch64-code.fd\")"
time="2024-05-04T10:11:54Z" level=info msg="[hostagent] Starting QEMU (hint: to watch the boot progress, see \"/Users/runner/.colima/_lima/colima/serial*.log\")"
time="2024-05-04T10:11:54Z" level=info msg="SSH Local Port: 49212"
time="2024-05-04T10:11:54Z" level=info msg="[hostagent] Waiting for the essential requirement 1 of 4: \"ssh\""
time="2024-05-04T10:11:54Z" level=info msg="[hostagent] Driver stopped due to error: \"signal: abort trap\""
time="2024-05-04T10:11:54Z" level=info msg="[hostagent] Shutting down the host agent"
time="2024-05-04T10:11:54Z" level=warning msg="[hostagent] failed to exit SSH master" error="failed to execute `ssh -O exit -p 49212 127.0.0.1`, out=\"Control socket connect(/Users/runner/.colima/_lima/colima/ssh.sock): No such file or directory\\r\\n\": exit status 255"
time="2024-05-04T10:11:54Z" level=info msg="[hostagent] Shutting down QEMU with ACPI"
time="2024-05-04T10:11:54Z" level=warning msg="[hostagent] Failed to remove SSH binding for port 49212"
time="2024-05-04T10:11:54Z" level=warning msg="[hostagent] failed to open the QMP socket \"/Users/runner/.colima/_lima/colima/qmp.sock\", forcibly killing QEMU" error="dial unix /Users/runner/.colima/_lima/colima/qmp.sock: connect: connection refused"
time="2024-05-04T10:11:54Z" level=info msg="[hostagent] QEMU has already exited"
time="2024-05-04T10:11:54Z" level=fatal msg="exiting, status={Running:false Degraded:false Exiting:true Errors:[] SSHLocalPort:0} (hint: see \"/Users/runner/.colima/_lima/colima/ha.stderr.log\")"
time="2024-05-04T10:11:54Z" level=fatal msg="error starting vm: error at 'creating and starting': exit status 1"
Error: Process completed with exit code 1.

AkihiroSuda commented 1 month ago

macos-14 (ARM) on GitHub Actions does not support Hypervisor.framework.

Older versions (Intel) should work.

undergroundwires commented 1 month ago

Using macos-13 has resolved it, thank you @AkihiroSuda ❤️

undergroundwires commented 1 month ago

macos-13 does no longer work. Microsoft seems to push out ARM64 default for macos-13 too. Does anyone know how to configure the runner so we request an intel instance of it? Both seems to co-exist.

undergroundwires commented 1 month ago

FYI: GitHub just today has changed macos-13 back to be Intel by default.. Pipelines have been getting broken a lot due to this..

I guess adding an architecture check in code, and aborting the operation if arm64 is received would be the only way to go if they keep breaking this inconsistently like this.

SmartManoj commented 1 week ago

time="2024-05-04T10:11:54Z" level=info msg="[hostagent] Driver stopped due to error: \"signal: abort trap\""

This is the starting point of the error?

abiosoft / colima