multipass 1.13.1 doesnt run VMs and state shows "unknown"

[amitchahalgits]

Describe the bug multipass 1.13.1 doesnt run VMs and state shows "unknown" Multipass version 1.13.1 MacOS version : Sonoma 14.5(ARM64)

To Reproduce How, and what happened?

1. mp launch jammy -n consul --cloud-init consul-server-cloud-init.yaml
2. multipass get local.driver qemu

Expected behavior With all things in place, ot should be able to spin VMs as expected.

Logs

[2024-05-22T06:28:10.105] [debug] [consul] Waiting for SSH to be up
[2024-05-22T06:28:10.488] [debug] [consul] QMP: {"QMP": {"version": {"qemu": {"micro": 1, "minor": 2, "major": 8}, "package": ""}, "capabilities": ["oob"]}}

[2024-05-22T06:28:10.538] [debug] [consul] QMP: {"return": {}}

[2024-05-22T06:28:23.019] [debug] [consul] QMP: {"timestamp": {"seconds": 1716323303, "microseconds": 19368}, "event": "NIC_RX_FILTER_CHANGED", "data": {"path": "/machine/unattached/device[6]/virtio-backend"}}

[2024-05-22T06:29:03.908] [debug] [consul] QMP: {"timestamp": {"seconds": 1716323343, "microseconds": 908602}, "event": "RTC_CHANGE", "data": {"offset": 1, "qom-path": "/machine/unattached/device[4]"}}

[2024-05-22T06:38:11.689] [debug] [async task] fetch manifest periodically
[2024-05-22T06:38:11.717] [info] [VMImageHost] Did not find any supported products in "appliance"
[2024-05-22T06:40:01.980] [debug] [consul] QMP: {"timestamp": {"seconds": 1716324001, "microseconds": 979525}, "event": "RTC_CHANGE", "data": {"offset": 1, "qom-path": "/machine/unattached/device[4]"}}

[2024-05-22T06:51:09.982] [debug] [consul] QMP: {"timestamp": {"seconds": 1716324669, "microseconds": 982085}, "event": "RTC_CHANGE", "data": {"offset": 1, "qom-path": "/machine/unattached/device[4]"}}

[2024-05-22T06:53:11.694] [debug] [async task] fetch manifest periodically
[2024-05-22T06:53:11.698] [info] [VMImageHost] Did not find any supported products in "appliance"

Additional info

• Multipass version 1.13.1
• MacOS version : Sonoma 14.5(ARM64)
• mp info consul

  mp info consul
  Name:           consul
  State:          Unknown
  Snapshots:      0
  IPv4:           --
  Release:        --
  Image hash:     f6bf7305207a (Ubuntu 22.04 LTS)
  CPU(s):         --
  Load:           --
  Disk usage:     --
  Memory usage:   --
  Mounts:         --

Additional context NA

[sharder996]

Hi @amitchahalgits

Can you please provide the output of the following commands:

sudo /Library/Application\ Support/com.canonical.multipass/bin/qemu-img info /var/root/Library/Application Support/multipassd/qemu/vault/instances/consul/ubuntu-22.04-server-cloudimg-amd64.img
sudo /Library/Application\ Support/com.canonical.multipass/bin/qemu-img check /var/root/Library/Application Support/multipassd/qemu/vault/instances/consul/ubuntu-22.04-server-cloudimg-amd64.img

Also, could you provide the contents of your cloud init file?

[SaRoKu]

Happens to me aswell, I recently udpated to 14.5 too. I had previously installed a regular ubuntu 22.04 server instance. Now it doesn't start, I've tried purging the image and launching another one, but after waiting a lot of time:

$ multipass launch docker
launch failed: The following errors occurred:
docker: timed out waiting for response
$ multipass list
Name                    State             IPv4             Image
docker                  Unknown           --               Ubuntu 22.04 LTS

[mdfranz]

Same results

` matt@matts-MBP ~ % multipass --version multipass   1.13.1+mac multipassd  1.13.1+mac matt@matts-MBP ~ % multipass start  launch failed: The following errors occurred: primary: timed out waiting for response [2024-05-23T15:43:38.268] [info] [daemon] Daemon arguments: /Library/Application Support/com.canonical.multipass/bin/multipassd --verbosity debug [2024-05-23T15:43:38.314] [debug] [update] Latest Multipass release available is version 1.13.1 [2024-05-23T15:44:01.558] [debug] [daemon] Deleting instance: primary [2024-05-23T15:44:01.558] [debug] [daemon] Instance deleted: primary [2024-05-23T15:44:12.016] [debug] [daemon] Instance purged: primary [2024-05-23T15:44:16.024] [debug] [qemu-system-aarch64] [9815] started: qemu-system-aarch64 --version [2024-05-23T15:44:16.721] [debug] [qemu-img] [9816] started: qemu-img info /var/root/Library/Caches/multipassd/qemu/vault/images/noble-20240423/ubuntu-24.04-server-cloudimg-arm64.img [2024-05-23T15:44:16.739] [debug] [qemu-img] [9817] started: qemu-img resize /var/root/Library/Application Support/multipassd/qemu/vault/instances/primary/ubuntu-24.04-server-cloudimg-arm64.img 5368709120 [2024-05-23T15:44:16.758] [debug] [qemu-img] [9818] started: qemu-img snapshot -l /var/root/Library/Application Support/multipassd/qemu/vault/instances/primary/ubuntu-24.04-server-cloudimg-arm64.img [2024-05-23T15:44:16.771] [debug] [qemu-img] [9819] started: qemu-img amend -o compat=1.1 /var/root/Library/Application Support/multipassd/qemu/vault/instances/primary/ubuntu-24.04-server-cloudimg-arm64.img [2024-05-23T15:44:16.784] [debug] [primary] process working dir '' [2024-05-23T15:44:16.784] [info] [primary] process program 'qemu-system-aarch64' [2024-05-23T15:44:16.784] [info] [primary] process arguments '-machine, virt,gic-version=3, -accel, hvf, -drive, file=/Library/Application Support/com.canonical.multipass/bin/../Resources/qemu/edk2-aarch64-code.fd,if=pflash,format=raw,readonly=on, -cpu, host, -nic, vmnet-shared,model=virtio-net-pci,mac=52:54:00:04:fd:36, -device, virtio-scsi-pci,id=scsi0, -drive, file=/var/root/Library/Application Support/multipassd/qemu/vault/instances/primary/ubuntu-24.04-server-cloudimg-arm64.img,if=none,format=qcow2,discard=unmap,id=hda, -device, scsi-hd,drive=hda,bus=scsi0.0, -smp, 1, -m, 1024M, -qmp, stdio, -chardev, null,id=char0, -serial, chardev:char0, -nographic, -cdrom, /var/root/Library/Application Support/multipassd/qemu/vault/instances/primary/cloud-init-config.iso' [2024-05-23T15:44:16.787] [debug] [qemu-system-aarch64] [9820] started: qemu-system-aarch64 -machine virt,gic-version=3 -nographic -dump-vmstate /private/var/folders/zz/zyxvpxvq6csfxvn_n0000000000000/T/multipassd.ZclatN [2024-05-23T15:44:16.832] [info] [primary] process state changed to Starting [2024-05-23T15:44:16.834] [info] [primary] process state changed to Running [2024-05-23T15:44:16.834] [debug] [qemu-system-aarch64] [9821] started: qemu-system-aarch64 -machine virt,gic-version=3 -accel hvf -drive file=/Library/Application Support/com.canonical.multipass/bin/../Resources/qemu/edk2-aarch64-code.fd,if=pflash,format=raw,readonly=on -cpu host -nic vmnet-shared,model=virtio-net-pci,mac=52:54:00:04:fd:36 -device virtio-scsi-pci,id=scsi0 -drive file=/var/root/Library/Application Support/multipassd/qemu/vault/instances/primary/ubuntu-24.04-server-cloudimg-arm64.img,if=none,format=qcow2,discard=unmap,id=hda -device scsi-hd,drive=hda,bus=scsi0.0 -smp 1 -m 1024M -qmp stdio -chardev null,id=char0 -serial chardev:char0 -nographic -cdrom /var/root/Library/Application Support/multipassd/qemu/vault/instances/primary/cloud-init-config.iso [2024-05-23T15:44:16.834] [info] [primary] process started [2024-05-23T15:44:16.835] [debug] [primary] Waiting for SSH to be up [2024-05-23T15:44:16.861] [debug] [primary] QMP: {"QMP": {"version": {"qemu": {"micro": 1, "minor": 2, "major": 8}, "package": ""}, "capabilities": ["oob"]}} [2024-05-23T15:44:16.882] [debug] [primary] QMP: {"return": {}} [2024-05-23T15:44:27.165] [debug] [primary] QMP: {"timestamp": {"seconds": 1716493467, "microseconds": 165754}, "event": "NIC_RX_FILTER_CHANGED", "data": {"path": "/machine/unattached/device[6]/virtio-backend"}} [2024-05-23T15:45:07.983] [debug] [primary] QMP: {"timestamp": {"seconds": 1716493507, "microseconds": 983138}, "event": "RTC_CHANGE", "data": {"offset": 1, "qom-path": "/machine/unattached/device[4]"}}

ReplyForwardAdd reaction

[SaRoKu]

Happens to me aswell, I recently udpated to 14.5 too. I had previously installed a regular ubuntu 22.04 server instance. Now it doesn't start, I've tried purging the image and launching another one, but after waiting a lot of time:

$ multipass launch docker
launch failed: The following errors occurred:
docker: timed out waiting for response
$ multipass list
Name                    State             IPv4             Image
docker                  Unknown           --               Ubuntu 22.04 LTS

I've tried reinstalling multipass and it didn't initially work, but after rebooting (I don't really know if that solved it) it works again.

EDIT: I've figured out what was wrong. I'm using a VPN connection, when it's connected I can't use multipass

[sharder996]

@mdfranz The likely cause of the Unknown state is probably because Multipass can't connect to the instance. This can happen if you're using a VPN or have your firewall turned on. If the issue still persists for you, can you post the logs of launching an instance?

[mdfranz]

Are there additional logs you are looking for besides what I posted above starting with

Correct me if I'm wrong but if it couldn't connect it couldn't start or purge?

[2024-05-23T15:43:38.268] [info] [daemon] Daemon arguments: /Library/Application Support/com.canonical.multipass/bin/multipassd --verbosity debug
[2024-05-23T15:43:38.314] [debug] [update] Latest Multipass release available is version 1.13.1
[2024-05-23T15:44:01.558] [debug] [daemon] Deleting instance: primary
[2024-05-23T15:44:01.558] [debug] [daemon] Instance deleted: primary
[2024-05-23T15:44:12.016] [debug] [daemon] Instance purged: primary
[2024-05-23T15:44:16.024] [debug] [qemu-system-aarch64] [9815] started: qemu-system-aarch64 --version
[2024-05-23T15:44:16.721] [debug] [qemu-img] [9816] started: qemu-img info /var/root/Library/Caches/multipassd/qemu/vault/images/noble-20240423/ubuntu-24.04-server-cloudimg-arm64.img
[2024-05-23T15:44:16.739] [debug] [qemu-img] [9817] started: qemu-img resize /var/root/Library/Application Support/multipassd/qemu/vault/instances/primary/ubuntu-24.04-server-cloudimg-arm64.img 5368709120
[2024-05-23T15:44:16.758] [debug] [qemu-img] [9818] started: qemu-img snapshot -l /var/root/Library/Application Support/multipassd/qemu/vault/instances/primary/ubuntu-24.04-server-cloudimg-arm64.img
[2024-05-23T15:44:16.771] [debug] [qemu-img] [9819] started: qemu-img amend -o compat=1.1 /var/root/Library/Application Support/multipassd/qemu/vault/instances/primary/ubuntu-24.04-server-cloudimg-arm64.img

[sharder996]

Sorry, I thought those were from another user. The NIC_RX_FILTER_CHANGED in the logs suggests that the instance has successfully started up and initialized the network interface, just that Multipass cannot connect to it. Can you confirm that you don't have anything else running that could affect the network (VPN, macOS firewall, etc). You may have to reboot the machine to any changes take effect.

[mdfranz]

Turns out my M3 had bad memory. 😬

[sharder996]

@amitchahalgits Can you confirm whether the issue has been solved for you or not? If not, would you be able to provide me the information from the commands I gave in my previous comments to you? Otherwise, if there is no longer an issue, I will close this issue.

Thanks!

[ricab]

Closing then. Please reopen if needed.