isard-vdi / isard

Isard VDI. Open Source KVM Virtual Desktops based on KVM Linux and dockers. Please use https://gitlab.com/isard/isardvdi
http://www.isardvdi.com
GNU Affero General Public License v3.0
192 stars 57 forks source link

After downal iso show failed isard-hypervisor error #445

Closed piotr-sikora-v closed 1 year ago

piotr-sikora-v commented 1 year ago

Hi, I have fresh install on ubuntu 22.04 LTS Everything start, but when I click download and after downloadn is finished then I see status "failed"

image

In logs I found there is some error in isard-hypervisor: isard-hypervisor | 2023-08-03 11:47:59.345+0000: 95: error : virCgroupV2DevicesDetectProg:378 : unable to open '/sys/fs/cgroup/machine/qemu-8-ce71fbda-bf49-417e-af0e-cfdddff1039a.libvirt-qemu/': No such file or directory isard-stats-cadvisor | W0803 11:47:59.345623 1 watcher.go:93] Error while processing event ("/sys/fs/cgroup/system.slice/docker-94fee8463215e455b96edbe520eeacf10b20482ce4bfc6d596e17c92918cf07d.scope/machine/qemu-8-ce71fbda-bf49-417e-af0e-cfdddff1039a.libvirt-qemu": 0x40000100 == IN_CREATE|IN_ISDIR): open /sys/fs/cgroup/system.slice/docker-94fee8463215e455b96edbe520eeacf10b20482ce4bfc6d596e17c92918cf07d.scope/machine/qemu-8-ce71fbda-bf49-417e-af0e-cfdddff1039a.libvirt-qemu: no such file or directory

Also I see some others things in logs... maybe this will help to solve me problem:


isard-hypervisor           | Accepted publickey for root from 172.31.255.14 port 43116 ssh2: RSA SHA256:oaXe4zBEs8xeY3+FdVEygg29uYDVSvCIck+9gKELLZI
isard-hypervisor           | Received disconnect from 172.31.255.14 port 43116:11: disconnected by user
isard-hypervisor           | Disconnected from user root 172.31.255.14 port 43116
isard-hypervisor           | Received disconnect from 172.31.255.14 port 57378:11: disconnected by user
isard-hypervisor           | Disconnected from user root 172.31.255.14 port 57378
isard-engine               | 2023-08-03 11:47:57,850 - downloads - INFO - domains_ce71fbda-bf49-417e-af0e-cfdddff1039a - File downloaded: /isard/groups/92d6b531-f00a-41f3-b00c-e85170d378cc.qcow2
isard-engine               | 2023/08/03 11:47:57 850 - INFO - domains_ce71fbda-bf49-417e-af0e-cfdddff1039a: File downloaded: /isard/groups/92d6b531-f00a-41f3-b00c-e85170d378cc.qcow2
isard-hypervisor           | kex_exchange_identification: Connection closed by remote host
isard-hypervisor           | Connection closed by 172.31.255.14 port 48628

isard-engine               | ORDER NUM:-1
isard-engine               | ORDER NUM:-1 REMAINING:1
isard-engine               | [(('boot_order', 0), 'disk'),
isard-engine               |  (('disks', 0, 'parent'), None),
isard-engine               |  (('disks', 0, 'path_selected'), '/isard/groups'),
isard-engine               |  (('disks', 0, 'storage_id'), '92d6b531-f00a-41f3-b00c-e85170d378cc'),
isard-engine               |  (('interfaces', 0, 'id'), 'default'),
isard-engine               |  (('interfaces', 0, 'name'), 'Default'),
isard-engine               |  (('interfaces', 1, 'id'), 'wireguard'),
isard-engine               |  (('interfaces', 1, 'name'), 'Wireguard VPN'),
isard-engine               |  (('interfaces', 1, 'net'), '4095'),
isard-engine               |  (('interfaces', 1, 'type'), 'ovs'),
isard-engine               |  (('uuid',), None),
isard-engine               |  (('video', 'heads'), 1),
isard-engine               |  (('video', 'ram'), 65536),
isard-engine               |  (('video', 'vram'), 65536)]
isard-engine               | [(('boot_menu_enable', 0), None),
isard-engine               |  (('boot_order', 0), 'hd'),
isard-engine               |  (('disks', 0, 'bus'), 'sata'),
isard-engine               |  (('disks', 0, 'dev'), 'sda'),
isard-engine               |  (('disks', 0, 'type'), 'qcow2'),
isard-engine               |  (('graphics', 'defaultMode'), None),
isard-engine               |  (('graphics', 'type'), 'spice'),
isard-engine               |  (('interfaces', 0, 'qos'), None),
isard-engine               |  (('interfaces', 1, 'net'), 'ovsbr0'),
isard-engine               |  (('interfaces', 1, 'qos'), None),
isard-engine               |  (('interfaces', 1, 'type'), 'bridge'),
isard-engine               |  (('uuid',), 'c1322d09-933d-412f-b9d5-3c64104b9ecc')]
isard-engine               | ORDER NUM:-1
isard-engine               | ORDER NUM:-1 REMAINING:2
isard-engine               | ORDER NUM:-1 REMAINING:1
isard-hypervisor           | 2023-08-03 11:47:59.331+0000: 95: warning : qemuDomainObjTaintMsg:6820 : Domain id=8 name='ce71fbda-bf49-417e-af0e-cfdddff1039a' uuid=c1322d09-933d-412f-b9d5-3c64104b9ecc is tainted: high-privileges
isard-hypervisor           | 2023-08-03 11:47:59.345+0000: 95: error : virCgroupSetValueRaw:531 : Unable to write to '/sys/fs/cgroup/machine/qemu-8-ce71fbda-bf49-417e-af0e-cfdddff1039a.libvirt-qemu/cgroup.procs': Not supported
isard-hypervisor           | 2023-08-03 11:47:59.345+0000: 95: error : virCgroupV2DevicesDetectProg:378 : unable to open '/sys/fs/cgroup/machine/qemu-8-ce71fbda-bf49-417e-af0e-cfdddff1039a.libvirt-qemu/': No such file or directory
isard-stats-cadvisor       | W0803 11:47:59.345623       1 watcher.go:93] Error while processing event ("/sys/fs/cgroup/system.slice/docker-94fee8463215e455b96edbe520eeacf10b20482ce4bfc6d596e17c92918cf07d.scope/machine/qemu-8-ce71fbda-bf49-417e-af0e-cfdddff1039a.libvirt-qemu": 0x40000100 == IN_CREATE|IN_ISDIR): open /sys/fs/cgroup/system.slice/docker-94fee8463215e455b96edbe520eeacf10b20482ce4bfc6d596e17c92918cf07d.scope/machine/qemu-8-ce71fbda-bf49-417e-af0e-cfdddff1039a.libvirt-qemu: no such file or directory
isard-scheduler            | 2023-08-03 11:47:59,526 - INFO     - 127.0.0.1 - - [2023-08-03 11:47:59] "GET /scheduler/healthcheck HTTP/1.1" 200 115 0.000810
isard-grafana-agent        | ts=2023-08-03T11:47:59.529232614Z caller=filetargetmanager.go:177 level=info component=logs logs_config=default msg="received file watcher event" name=/var/lib/docker/containers/2ba93a9519174f3452ac96ea123fa91bb2dbd816856cec690895dff3eb89a762/.tmp-config.v2.json3289232605 op=CREATE
isard-grafana-agent        | ts=2023-08-03T11:47:59.529879818Z caller=filetargetmanager.go:177 level=info component=logs logs_config=default msg="received file watcher event" name=/var/lib/docker/containers/2ba93a9519174f3452ac96ea123fa91bb2dbd816856cec690895dff3eb89a762/.tmp-hostconfig.json1401035197 op=CREATE
isard-grafana-agent        | ts=2023-08-03T11:47:59.530876596Z caller=filetargetmanager.go:177 level=info component=logs logs_config=default msg="received file watcher event" name=/var/lib/docker/containers/2ba93a9519174f3452ac96ea123fa91bb2dbd816856cec690895dff3eb89a762/hostconfig.json op=CREATE
isard-grafana-agent        | ts=2023-08-03T11:47:59.531511358Z caller=filetargetmanager.go:177 level=info component=logs logs_config=default msg="received file watcher event" name=/var/lib/docker/containers/2ba93a9519174f3452ac96ea123fa91bb2dbd816856cec690895dff3eb89a762/config.v2.json op=CREATE
isard-grafana-agent        | ts=2023-08-03T11:47:59.635886909Z caller=filetargetmanager.go:177 level=info component=logs logs_config=default msg="received file watcher event" name=/var/lib/docker/containers/6c519b0b879cf5a6a2786c6591b77051b826102cf90d18abd7991f85ff54b548/.tmp-config.v2.json2243921177 op=CREATE
isard-grafana-agent        | ts=2023-08-03T11:47:59.636584824Z caller=filetargetmanager.go:177 level=info component=logs logs_config=default msg="received file watcher event" name=/var/lib/docker/containers/6c519b0b879cf5a6a2786c6591b77051b826102cf90d18abd7991f85ff54b548/.tmp-hostconfig.json2038465536 op=CREATE
isard-grafana-agent        | ts=2023-08-03T11:47:59.637559482Z caller=filetargetmanager.go:177 level=info component=logs logs_config=default msg="received file watcher event" name=/var/lib/docker/containers/6c519b0b879cf5a6a2786c6591b77051b826102cf90d18abd7991f85ff54b548/hostconfig.json op=CREATE
isard-grafana-agent        | ts=2023-08-03T11:47:59.638233398Z caller=filetargetmanager.go:177 level=info component=logs logs_config=default msg="received file watcher event" name=/var/lib/docker/containers/6c519b0b879cf5a6a2786c6591b77051b826102cf90d18abd7991f85ff54b548/config.v2.json op=CREATE
isard-engine               | 2023-08-03 11:47:59,644 - main - INFO - manager_pooling - #####  CHANGES IN THREADS THREADS ##################
isard-engine               | 2023/08/03 11:47:59 644 - INFO - manager_pooling: #####  CHANGES IN THREADS THREADS ##################
isard-engine               | 2023-08-03 11:47:59,645 - threads - INFO - manager_pooling - 
isard-engine               | |      | state                                        |   name |   tid |              id |
isard-engine               | |------|----------------------------------------------|--------|-------|-----------------|
isard-engine               | | dead | domains_ce71fbda-bf49-417e-af0e-cfdddff1039a |   3095 |     0 | 140599531580216 |
isard-engine               | 2023/08/03 11:47:59 645 - INFO - manager_pooling: 
isard-engine               | |      | state                                        |   name |   tid |              id |
isard-api                  | {"service": "api", "duration": 0.0002, "status": 200, "path": "/api/v3", "method": "GET", "remote_addr": "127.0.0.1", "msg": "response served", "level": "info", "time": "2023-08-03T11:47:59+00:00"}
isard-engine               | |------|----------------------------------------------|--------|-------|-----------------|
isard-engine               | | dead | domains_ce71fbda-bf49-417e-af0e-cfdddff1039a |   3095 |     0 | 140599531580216 |
isard-grafana-agent        | ts=2023-08-03T11:47:59.648924744Z caller=filetargetmanager.go:177 level=info component=logs logs_config=default msg="received file watcher event" name=/var/lib/docker/containers/3e514f98a16935f4467b2bae6af84162635b2bcc7e2938a9c470c8c83c0703ce/.tmp-config.v2.json1027769248 op=CREATE
isard-grafana-agent        | ts=2023-08-03T11:47:59.649843936Z caller=filetargetmanager.go:177 level=info component=logs logs_config=default msg="received file watcher event" name=/var/lib/docker/containers/3e514f98a16935f4467b2bae6af84162635b2bcc7e2938a9c470c8c83c0703ce/.tmp-hostconfig.json3682049353 op=CREATE
isard-grafana-agent        | ts=2023-08-03T11:47:59.650807679Z caller=filetargetmanager.go:177 level=info component=logs logs_config=default msg="received file watcher event" name=/var/lib/docker/containers/3e514f98a16935f4467b2bae6af84162635b2bcc7e2938a9c470c8c83c0703ce/hostconfig.json op=CREATE
isard-grafana-agent        | ts=2023-08-03T11:47:59.65147797Z caller=filetargetmanager.go:177 level=info component=logs logs_config=default msg="received file watcher event" name=/var/lib/docker/containers/3e514f98a16935f4467b2bae6af84162635b2bcc7e2938a9c470c8c83c0703ce/config.v2.json op=CREATE
isard-engine               | libvirt: Cgroup error : unable to open '/sys/fs/cgroup/machine/qemu-8-ce71fbda-bf49-417e-af0e-cfdddff1039a.libvirt-qemu/': No such file or directory
isard-engine               | 2023-08-03 11:47:59,849 - workers - ERROR - worker_isard-hypervisor - Exception in libvirt starting paused xml for domain ce71fbda-bf49-417e-af0e-cfdddff1039a in hypervisor isard-hypervisor. Exception message: ('unable to open '
isard-engine               |  "'/sys/fs/cgroup/machine/qemu-8-ce71fbda-bf49-417e-af0e-cfdddff1039a.libvirt-qemu/': "
isard-engine               |  'No such file or directory') 
isard-engine               | 2023/08/03 11:47:59 849 - ERROR - worker_isard-hypervisor: Exception in libvirt starting paused xml for domain ce71fbda-bf49-417e-af0e-cfdddff1039a in hypervisor isard-hypervisor. Exception message: ('unable to open '
isard-engine               |  "'/sys/fs/cgroup/machine/qemu-8-ce71fbda-bf49-417e-af0e-cfdddff1039a.libvirt-qemu/': "
isard-engine               |  'No such file or directory') 
isard-engine               | 2023/08/03 11:47:59 849 - ERROR - worker_isard-hypervisor: Exception in libvirt starting paused xml for domain ce71fbda-bf49-417e-af0e-cfdddff1039a in hypervisor isard-hypervisor. Exception message: ('unable to open '
isard-engine               |  "'/sys/fs/cgroup/machine/qemu-8-ce71fbda-bf49-417e-af0e-cfdddff1039a.libvirt-qemu/': "
isard-engine               |  'No such file or directory') 

Thanks in advanced

piotr-sikora-v commented 1 year ago

Problem solved... IsardVDI use cgroup v1, but Ubuntu 22.04 LTS is using by default cgroup v2

Quick solution:

in /etc/default/grub add to GRUB_CMDLINE_LINUX option systemd.unified_cgroup_hierarchy=0 i.e.:

GRUB_CMDLINE_LINUX="systemd.unified_cgroup_hierarchy=0"

After that, everything start now works! :smile: