skyshe commented 3 years ago

Hi

host1： libvirtd -V libvirtd (libvirt) 4.0.0

host2： libvirtd -V libvirtd (libvirt) 4.0.0

host1： cat /etc/issue Ubuntu 18.04.6 LTS \n \l host2： cat /etc/issue Ubuntu 18.04.6 LTS \n \l

I installed the ubuntu 18.04 system on 2 physical hosts, and both deployed libvirtd Host 1 deploys webvirtcloud and libvirtd, and they are used normally. Host 2 only deploys libvirtd to connect to host 1's webvirtcloud via TCP, but an error is reported when using the migration function. Destination host emulator is different. Cannot be migrated

What could be the cause of this, and what should I do?

thanks

err imges： ![Uploading 20211014183144.jpg…]()

catborise commented 3 years ago

qemu-kvm version is important. libvirt version has minor effect. run virsh version command to see difference…

skyshe commented 3 years ago

What puzzles me is that they are not different。

host1： virsh version Compiled against library: libvirt 4.0.0 Using library: libvirt 4.0.0 Using API: QEMU 4.0.0 Running hypervisor: QEMU 2.11.1

host2： virsh version Compiled against library: libvirt 4.0.0 Using library: libvirt 4.0.0 Using API: QEMU 4.0.0 Running hypervisor: QEMU 2.11.1

catborise commented 3 years ago

Interesting, can you please check it if it working on cli with; virsh migrate --live --persistent --undefinesource --verbose <vm name> qemu+ssh://<user@destinationip>/system

skyshe commented 3 years ago

When I execute it for the first time, it prompts that the storage file does not exist. When I manually scp the storage file to host 2, it prompts an error again.

err1 virsh migrate --live --persistent --undefinesource --verbose vm1 qemu+ssh://172.16.0.2/system error: Cannot access storage file '/kvm/vfs/vm1.qcow2' (as uid:64055, gid:114): No such file or directory

virsh migrate --live --persistent --undefinesource --verbose vm1 qemu+tcp://172.16.0.2/system error: Cannot access storage file '/kvm/vfs/vm1.qcow2' (as uid:64055, gid:114): No such file or directory

err2 virsh migrate --live --persistent --undefinesource --verbose vm1 qemu+tcp://172.16.0.2/system error: Unable to resolve address 'andy' service '49152': Temporary failure in name resolution

virsh migrate --live --persistent --undefinesource --verbose vm1 qemu+ssh://172.16.0.2/system error: Unable to resolve address 'andy' service '49152': Temporary failure in name resolution

catborise commented 3 years ago

first of all, check your services for libvirt daemon. It should be in listening mode. (https://askubuntu.com/questions/423425/i-cant-use-libvirt-with-listen-tcp)

It would be nice to have NFS storage to keep vm disks for migration. if you do not have it then you should look at this article(https://hgj.hu/live-migrating-a-virtual-machine-with-libvirt-without-a-shared-storage/)

skyshe commented 3 years ago

First of all, thank you for your enthusiastic answer.

The libvirt daemon service of my host 2 is running. TCP connection is in listening mode。

netstat -lntp (Not all processes could be identified, non-owned process info will not be shown, you would have to be root to see it all.) Active Internet connections (only servers) Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name
tcp 0 0 127.0.0.1:6010 0.0.0.0: LISTEN -
tcp 0 0 0.0.0.0:16509 0.0.0.0: LISTEN -
tcp 0 0 0.0.0.0:16510 0.0.0.0: LISTEN -
tcp 0 0 0.0.0.0:5900 0.0.0.0: LISTEN -
tcp 0 0 0.0.0.0:80 0.0.0.0: LISTEN -
tcp 0 0 192.168.100.1:53 0.0.0.0: LISTEN -
tcp 0 0 127.0.0.53:53 0.0.0.0: LISTEN -
tcp 0 0 0.0.0.0:22 0.0.0.0: LISTEN -
tcp6 0 0 ::1:6010 ::: LISTEN -
tcp6 0 0 :::80 ::: LISTEN -
tcp6 0 0 240c::1:53 ::: LISTEN -
tcp6 0 0 fe80::5054:ff:fedd:4:53 ::: LISTEN -
tcp6 0 0 :::22 :::* LISTEN -

systemctl status libvirt-bin.service

● libvirtd.service - Virtualization daemon Loaded: loaded (/lib/systemd/system/libvirtd.service; enabled; vendor preset: enabled) Active: active (running) since Thu 2021-10-14 18:23:21 CST; 22h ago Docs: man:libvirtd(8) https://libvirt.org Main PID: 2529 (libvirtd) Tasks: 27 (limit: 32768) CGroup: /system.slice/libvirtd.service ├─2089 /usr/sbin/dnsmasq --conf-file=/var/lib/libvirt/dnsmasq/NAT.conf --leasefile-ro --dhcp-script=/usr/lib/libvirt/libvirt_leaseshelper ├─2090 /usr/sbin/dnsmasq --conf-file=/var/lib/libvirt/dnsmasq/NAT.conf --leasefile-ro --dhcp-script=/usr/lib/libvirt/libvirt_leaseshelper ├─2529 /usr/sbin/libvirtd -l └─5034 qemu-system-x86_64 -enable-kvm -name guest=vyos,debug-threads=on -S -object secret,id=masterKey0,format=raw,file=/var/lib/libvirt/qemu/domain-1-vyos/master-key.aes -machine pc-i440fx-2.11,accel=kvm,usb=off,

systemctl status libvirtd.service.service

Unit libvirtd.service.service could not be found. andy@andy:~$ systemctl status libvirtd.service ● libvirtd.service - Virtualization daemon Loaded: loaded (/lib/systemd/system/libvirtd.service; enabled; vendor preset: enabled) Active: active (running) since Thu 2021-10-14 18:23:21 CST; 22h ago Docs: man:libvirtd(8) https://libvirt.org Main PID: 2529 (libvirtd) Tasks: 27 (limit: 32768) CGroup: /system.slice/libvirtd.service ├─2089 /usr/sbin/dnsmasq --conf-file=/var/lib/libvirt/dnsmasq/NAT.conf --leasefile-ro --dhcp-script=/usr/lib/libvirt/libvirt_leaseshelper ├─2090 /usr/sbin/dnsmasq --conf-file=/var/lib/libvirt/dnsmasq/NAT.conf --leasefile-ro --dhcp-script=/usr/lib/libvirt/libvirt_leaseshelper ├─2529 /usr/sbin/libvirtd -l

skyshe commented 3 years ago

20211015170002

skyshe commented 3 years ago

The current problems encountered are:

Migrate in the web console and report an error Destination host emulator is different. Cannot be migrated
Operation in cli reports an error, error: Unable to resolve address'andy' service '49152': Temporary failure in name resolution

catborise commented 3 years ago

sorry for late answer. webvirtcloud is an interface, nothing more. if you cannot migrate with "virsh migrate" command, webvirtcloud cannot also. you should fix it with libvirt configuration. "Operation in cli reports an error, error: Unable to resolve address'andy' service '49152': Temporary failure in name resolution" there should not be any service with named andy. may be it is related with firewall: https://stackoverflow.com/questions/55396045/live-migrate-kvm-vm-failed-with-tcp-connection-in-ubuntu

skyshe commented 3 years ago

Hi

First of all thank you for your reply,

Currently, two-way migration under cli is normal,

but migration under WebVirtCloud still prompts an error:（Destination host emulator is different. Cannot be migrated）

At present, WebVirtCloud reports an error during the migration operation and still can't find a solution.

host1 virsh migrate --live --persistent --verbose 5 qemu+ssh://172.16.0.2/system Migration: [100 %] virsh migrate --live --persistent --verbose 7 qemu+tcp://172.16.0.2/system Migration: [100 %]

host2 virsh migrate --live --persistent --verbose 18 qemu+ssh://172.16.0.1/system Migration: [100 %] virsh migrate --live --persistent --verbose 17 qemu+tcp://172.16.0.1/system Migration: [100 %]

skyshe commented 2 years ago

I now use the virsh migrate command, including the use of virt-manager UI to connect to the host and the migration is normal, but the migration operation is still not possible in webvirtcloud, every time it is prompted: Destination host emulator is different. Cannot be migrated

sudo virsh migrate --live --persistent --verbose vm1.xxx.com qemu+tcp://172.16.0.1/system Migration: [100 %]

catborise commented 2 years ago

may be the problem is related with host adding method. one host added with "localhost" the other is with ip.

can you please add both hosts with IP adress, then try it again.

skyshe commented 2 years ago

Currently, all TCP connections are used in WebVirtCloud.

connect qemu+tcp://172.16.0.1/system connect qemu+tcp://172.16.0.2/system

node1:~$ virsh version Compiled against library: libvirt 4.0.0 Using library: libvirt 4.0.0 Using API: QEMU 4.0.0 Running hypervisor: QEMU 2.11.1

node2:~$ virsh version Compiled against library: libvirt 4.0.0 Using library: libvirt 4.0.0 Using API: QEMU 4.0.0 Running hypervisor: QEMU 2.11.1

catborise commented 2 years ago

there must be a glitch we should detect: can you please check emulator on host overview page to see if they are same on both host

skyshe commented 2 years ago

The host overview page and virsh version show the same version

node1

node2

skyshe commented 2 years ago

The host overview page and virsh version show the same version

node1

node2

catborise commented 2 years ago

can you post also instance XML definition.

skyshe commented 2 years ago

This is the xml of one of the VMs

vm.txt

xx.xx.com fb0ef64c-2c87-4175-84d7-faf31cd78b44 xx.xx.com xx.xx.com 1048576 1048576 1 /machine hvm destroy restart restart /usr/bin/kvm-spice

catborise commented 2 years ago

please share with me output of virsh capabilities command. run this command on both hosts

skyshe commented 2 years ago

node1 1.txt

node2 2.txt

catborise commented 2 years ago

attaching text file can be dangerous you can add content with code block (with three apostrophe not one `) by the way; i guess your problem is related with emulator difference. what the heck is that: <emulator>/usr/bin/kvm-spice</emulator> ubuntu kvm 2.11 package has riddiculus addings. can you please change XML manually with <emulator>/usr/bin/kvm-spice</emulator> to <emulator>/usr/bin/qemu-system-x86_64</emulator>

skyshe commented 2 years ago

node1

<capabilities>

  <host>
    <uuid>c543102a-ef21-11df-a3f5-001517fbf81c</uuid>
    <cpu>
      <arch>x86_64</arch>
      <model>Nehalem-IBRS</model>
      <vendor>Intel</vendor>
      <microcode version='29'/>
      <topology sockets='1' cores='4' threads='1'/>
      <feature name='vme'/>
      <feature name='ds'/>
      <feature name='acpi'/>
      <feature name='ss'/>
      <feature name='ht'/>
      <feature name='tm'/>
      <feature name='pbe'/>
      <feature name='dtes64'/>
      <feature name='monitor'/>
      <feature name='ds_cpl'/>
      <feature name='vmx'/>
      <feature name='est'/>
      <feature name='tm2'/>
      <feature name='xtpr'/>
      <feature name='pdcm'/>
      <feature name='dca'/>
      <feature name='ssbd'/>
      <feature name='rdtscp'/>
      <feature name='invtsc'/>
      <pages unit='KiB' size='4'/>
      <pages unit='KiB' size='2048'/>
    </cpu>
    <power_management>
      <suspend_mem/>
      <suspend_disk/>
      <suspend_hybrid/>
    </power_management>
    <migration_features>
      <live/>
      <uri_transports>
        <uri_transport>tcp</uri_transport>
        <uri_transport>rdma</uri_transport>
      </uri_transports>
    </migration_features>
    <topology>
      <cells num='2'>
        <cell id='0'>
          <memory unit='KiB'>8107088</memory>
          <pages unit='KiB' size='4'>2026772</pages>
          <pages unit='KiB' size='2048'>0</pages>
          <distances>
            <sibling id='0' value='10'/>
            <sibling id='1' value='21'/>
          </distances>
          <cpus num='4'>
            <cpu id='0' socket_id='0' core_id='0' siblings='0'/>
            <cpu id='2' socket_id='0' core_id='1' siblings='2'/>
            <cpu id='4' socket_id='0' core_id='2' siblings='4'/>
            <cpu id='6' socket_id='0' core_id='3' siblings='6'/>
          </cpus>
        </cell>
        <cell id='1'>
          <memory unit='KiB'>16513664</memory>
          <pages unit='KiB' size='4'>4128416</pages>
          <pages unit='KiB' size='2048'>0</pages>
          <distances>
            <sibling id='0' value='21'/>
            <sibling id='1' value='10'/>
          </distances>
          <cpus num='4'>
            <cpu id='1' socket_id='1' core_id='0' siblings='1'/>
            <cpu id='3' socket_id='1' core_id='1' siblings='3'/>
            <cpu id='5' socket_id='1' core_id='2' siblings='5'/>
            <cpu id='7' socket_id='1' core_id='3' siblings='7'/>
          </cpus>
        </cell>
      </cells>
    </topology>
    <cache>
      <bank id='0' level='3' type='both' size='4' unit='MiB' cpus='0,2,4,6'/>
      <bank id='1' level='3' type='both' size='4' unit='MiB' cpus='1,3,5,7'/>
    </cache>
    <secmodel>
      <model>apparmor</model>
      <doi>0</doi>
    </secmodel>
    <secmodel>
      <model>dac</model>
      <doi>0</doi>
      <baselabel type='kvm'>+64055:+114</baselabel>
      <baselabel type='qemu'>+64055:+114</baselabel>
    </secmodel>
  </host>

  <guest>
    <os_type>hvm</os_type>
    <arch name='i686'>
      <wordsize>32</wordsize>
      <emulator>/usr/bin/qemu-system-i386</emulator>
      <machine maxCpus='255'>pc-i440fx-bionic</machine>
      <machine canonical='pc-i440fx-bionic' maxCpus='255'>ubuntu</machine>
      <machine maxCpus='1'>isapc</machine>
      <machine maxCpus='255'>pc-1.1</machine>
      <machine maxCpus='255'>pc-1.2</machine>
      <machine maxCpus='255'>pc-1.3</machine>
      <machine maxCpus='255'>pc-i440fx-zesty</machine>
      <machine maxCpus='255'>pc-i440fx-2.8</machine>
      <machine maxCpus='255'>pc-1.0</machine>
      <machine maxCpus='255'>pc-i440fx-2.9</machine>
      <machine maxCpus='255'>pc-i440fx-2.6</machine>
      <machine maxCpus='255'>pc-i440fx-2.7</machine>
      <machine maxCpus='128'>xenfv</machine>
      <machine maxCpus='255'>pc-i440fx-wily</machine>
      <machine maxCpus='255'>pc-i440fx-2.3</machine>
      <machine maxCpus='255'>pc-i440fx-2.4</machine>
      <machine maxCpus='255'>pc-i440fx-2.5</machine>
      <machine maxCpus='255'>pc-i440fx-yakkety</machine>
      <machine maxCpus='255'>pc-i440fx-2.1</machine>
      <machine maxCpus='255'>pc-i440fx-2.2</machine>
      <machine maxCpus='255'>pc-i440fx-2.0</machine>
      <machine maxCpus='255'>pc-q35-yakkety</machine>
      <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
      <machine maxCpus='288'>pc-q35-2.11</machine>
      <machine canonical='pc-q35-2.11' maxCpus='288'>q35</machine>
      <machine maxCpus='255'>pc-i440fx-xenial</machine>
      <machine maxCpus='1'>xenpv</machine>
      <machine maxCpus='288'>pc-q35-2.10</machine>
      <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
      <machine maxCpus='255'>pc-q35-xenial</machine>
      <machine maxCpus='255'>pc-i440fx-artful</machine>
      <machine maxCpus='255'>pc-i440fx-1.7</machine>
      <machine maxCpus='288'>pc-q35-2.9</machine>
      <machine maxCpus='255'>pc-0.15</machine>
      <machine maxCpus='255'>pc-i440fx-1.5</machine>
      <machine maxCpus='255'>pc-q35-2.7</machine>
      <machine maxCpus='255'>pc-i440fx-1.6</machine>
      <machine maxCpus='255'>pc-i440fx-2.11</machine>
      <machine canonical='pc-i440fx-2.11' maxCpus='255'>pc</machine>
      <machine maxCpus='288'>pc-q35-2.8</machine>
      <machine maxCpus='288'>pc-q35-zesty</machine>
      <machine maxCpus='255'>pc-0.13</machine>
      <machine maxCpus='288'>pc-q35-artful</machine>
      <machine maxCpus='255'>pc-0.14</machine>
      <machine maxCpus='255'>pc-q35-2.4</machine>
      <machine maxCpus='255'>pc-i440fx-trusty</machine>
      <machine maxCpus='255'>pc-q35-2.5</machine>
      <machine maxCpus='255'>pc-q35-2.6</machine>
      <machine maxCpus='255'>pc-i440fx-1.4</machine>
      <machine maxCpus='255'>pc-i440fx-2.10</machine>
      <machine maxCpus='255'>pc-0.11</machine>
      <machine maxCpus='255'>pc-0.12</machine>
      <machine maxCpus='288'>pc-q35-bionic</machine>
      <machine maxCpus='255'>pc-0.10</machine>
      <domain type='qemu'/>
      <domain type='kvm'>
        <emulator>/usr/bin/kvm-spice</emulator>
        <machine maxCpus='255'>pc-i440fx-bionic</machine>
        <machine canonical='pc-i440fx-bionic' maxCpus='255'>ubuntu</machine>
        <machine maxCpus='1'>isapc</machine>
        <machine maxCpus='255'>pc-1.1</machine>
        <machine maxCpus='255'>pc-1.2</machine>
        <machine maxCpus='255'>pc-1.3</machine>
        <machine maxCpus='255'>pc-i440fx-zesty</machine>
        <machine maxCpus='255'>pc-i440fx-2.8</machine>
        <machine maxCpus='255'>pc-1.0</machine>
        <machine maxCpus='255'>pc-i440fx-2.9</machine>
        <machine maxCpus='255'>pc-i440fx-2.6</machine>
        <machine maxCpus='255'>pc-i440fx-2.7</machine>
        <machine maxCpus='128'>xenfv</machine>
        <machine maxCpus='255'>pc-i440fx-wily</machine>
        <machine maxCpus='255'>pc-i440fx-2.3</machine>
        <machine maxCpus='255'>pc-i440fx-2.4</machine>
        <machine maxCpus='255'>pc-i440fx-2.5</machine>
        <machine maxCpus='255'>pc-i440fx-yakkety</machine>
        <machine maxCpus='255'>pc-i440fx-2.1</machine>
        <machine maxCpus='255'>pc-i440fx-2.2</machine>
        <machine maxCpus='255'>pc-i440fx-2.0</machine>
        <machine maxCpus='255'>pc-q35-yakkety</machine>
        <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
        <machine maxCpus='288'>pc-q35-2.11</machine>
        <machine canonical='pc-q35-2.11' maxCpus='288'>q35</machine>
        <machine maxCpus='255'>pc-i440fx-xenial</machine>
        <machine maxCpus='1'>xenpv</machine>
        <machine maxCpus='288'>pc-q35-2.10</machine>
        <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
        <machine maxCpus='255'>pc-q35-xenial</machine>
        <machine maxCpus='255'>pc-i440fx-artful</machine>
        <machine maxCpus='255'>pc-i440fx-1.7</machine>
        <machine maxCpus='288'>pc-q35-2.9</machine>
        <machine maxCpus='255'>pc-0.15</machine>
        <machine maxCpus='255'>pc-i440fx-1.5</machine>
        <machine maxCpus='255'>pc-q35-2.7</machine>
        <machine maxCpus='255'>pc-i440fx-1.6</machine>
        <machine maxCpus='255'>pc-i440fx-2.11</machine>
        <machine canonical='pc-i440fx-2.11' maxCpus='255'>pc</machine>
        <machine maxCpus='288'>pc-q35-2.8</machine>
        <machine maxCpus='288'>pc-q35-zesty</machine>
        <machine maxCpus='255'>pc-0.13</machine>
        <machine maxCpus='288'>pc-q35-artful</machine>
        <machine maxCpus='255'>pc-0.14</machine>
        <machine maxCpus='255'>pc-q35-2.4</machine>
        <machine maxCpus='255'>pc-i440fx-trusty</machine>
        <machine maxCpus='255'>pc-q35-2.5</machine>
        <machine maxCpus='255'>pc-q35-2.6</machine>
        <machine maxCpus='255'>pc-i440fx-1.4</machine>
        <machine maxCpus='255'>pc-i440fx-2.10</machine>
        <machine maxCpus='255'>pc-0.11</machine>
        <machine maxCpus='255'>pc-0.12</machine>
        <machine maxCpus='288'>pc-q35-bionic</machine>
        <machine maxCpus='255'>pc-0.10</machine>
      </domain>
    </arch>
    <features>
      <cpuselection/>
      <deviceboot/>
      <disksnapshot default='on' toggle='no'/>
      <acpi default='on' toggle='yes'/>
      <apic default='on' toggle='no'/>
      <pae/>
      <nonpae/>
    </features>
  </guest>

  <guest>
    <os_type>hvm</os_type>
    <arch name='x86_64'>
      <wordsize>64</wordsize>
      <emulator>/usr/bin/qemu-system-x86_64</emulator>
      <machine maxCpus='255'>pc-i440fx-bionic</machine>
      <machine canonical='pc-i440fx-bionic' maxCpus='255'>ubuntu</machine>
      <machine maxCpus='1'>isapc</machine>
      <machine maxCpus='255'>pc-1.1</machine>
      <machine maxCpus='255'>pc-1.2</machine>
      <machine maxCpus='255'>pc-1.3</machine>
      <machine maxCpus='255'>pc-i440fx-zesty</machine>
      <machine maxCpus='255'>pc-i440fx-2.8</machine>
      <machine maxCpus='255'>pc-1.0</machine>
      <machine maxCpus='255'>pc-i440fx-2.9</machine>
      <machine maxCpus='255'>pc-i440fx-2.6</machine>
      <machine maxCpus='255'>pc-i440fx-2.7</machine>
      <machine maxCpus='128'>xenfv</machine>
      <machine maxCpus='255'>pc-i440fx-wily</machine>
      <machine maxCpus='255'>pc-i440fx-2.3</machine>
      <machine maxCpus='255'>pc-i440fx-2.4</machine>
      <machine maxCpus='255'>pc-i440fx-2.5</machine>
      <machine maxCpus='255'>pc-i440fx-yakkety</machine>
      <machine maxCpus='255'>pc-i440fx-2.1</machine>
      <machine maxCpus='255'>pc-i440fx-2.2</machine>
      <machine maxCpus='255'>pc-i440fx-2.0</machine>
      <machine maxCpus='255'>pc-q35-yakkety</machine>
      <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
      <machine maxCpus='288'>pc-q35-2.11</machine>
      <machine canonical='pc-q35-2.11' maxCpus='288'>q35</machine>
      <machine maxCpus='255'>pc-i440fx-xenial</machine>
      <machine maxCpus='1'>xenpv</machine>
      <machine maxCpus='288'>pc-q35-2.10</machine>
      <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
      <machine maxCpus='255'>pc-q35-xenial</machine>
      <machine maxCpus='255'>pc-i440fx-artful</machine>
      <machine maxCpus='255'>pc-i440fx-1.7</machine>
      <machine maxCpus='288'>pc-q35-2.9</machine>
      <machine maxCpus='255'>pc-0.15</machine>
      <machine maxCpus='255'>pc-i440fx-1.5</machine>
      <machine maxCpus='255'>pc-q35-2.7</machine>
      <machine maxCpus='255'>pc-i440fx-1.6</machine>
      <machine maxCpus='255'>pc-i440fx-2.11</machine>
      <machine canonical='pc-i440fx-2.11' maxCpus='255'>pc</machine>
      <machine maxCpus='288'>pc-q35-2.8</machine>
      <machine maxCpus='288'>pc-q35-zesty</machine>
      <machine maxCpus='255'>pc-0.13</machine>
      <machine maxCpus='288'>pc-q35-artful</machine>
      <machine maxCpus='255'>pc-0.14</machine>
      <machine maxCpus='255'>pc-q35-2.4</machine>
      <machine maxCpus='255'>pc-i440fx-trusty</machine>
      <machine maxCpus='255'>pc-q35-2.5</machine>
      <machine maxCpus='255'>pc-q35-2.6</machine>
      <machine maxCpus='255'>pc-i440fx-1.4</machine>
      <machine maxCpus='255'>pc-i440fx-2.10</machine>
      <machine maxCpus='255'>pc-0.11</machine>
      <machine maxCpus='255'>pc-0.12</machine>
      <machine maxCpus='288'>pc-q35-bionic</machine>
      <machine maxCpus='255'>pc-0.10</machine>
      <domain type='qemu'/>
      <domain type='kvm'>
        <emulator>/usr/bin/kvm-spice</emulator>
        <machine maxCpus='255'>pc-i440fx-bionic</machine>
        <machine canonical='pc-i440fx-bionic' maxCpus='255'>ubuntu</machine>
        <machine maxCpus='1'>isapc</machine>
        <machine maxCpus='255'>pc-1.1</machine>
        <machine maxCpus='255'>pc-1.2</machine>
        <machine maxCpus='255'>pc-1.3</machine>
        <machine maxCpus='255'>pc-i440fx-zesty</machine>
        <machine maxCpus='255'>pc-i440fx-2.8</machine>
        <machine maxCpus='255'>pc-1.0</machine>
        <machine maxCpus='255'>pc-i440fx-2.9</machine>
        <machine maxCpus='255'>pc-i440fx-2.6</machine>
        <machine maxCpus='255'>pc-i440fx-2.7</machine>
        <machine maxCpus='128'>xenfv</machine>
        <machine maxCpus='255'>pc-i440fx-wily</machine>
        <machine maxCpus='255'>pc-i440fx-2.3</machine>
        <machine maxCpus='255'>pc-i440fx-2.4</machine>
        <machine maxCpus='255'>pc-i440fx-2.5</machine>
        <machine maxCpus='255'>pc-i440fx-yakkety</machine>
        <machine maxCpus='255'>pc-i440fx-2.1</machine>
        <machine maxCpus='255'>pc-i440fx-2.2</machine>
        <machine maxCpus='255'>pc-i440fx-2.0</machine>
        <machine maxCpus='255'>pc-q35-yakkety</machine>
        <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
        <machine maxCpus='288'>pc-q35-2.11</machine>
        <machine canonical='pc-q35-2.11' maxCpus='288'>q35</machine>
        <machine maxCpus='255'>pc-i440fx-xenial</machine>
        <machine maxCpus='1'>xenpv</machine>
        <machine maxCpus='288'>pc-q35-2.10</machine>
        <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
        <machine maxCpus='255'>pc-q35-xenial</machine>
        <machine maxCpus='255'>pc-i440fx-artful</machine>
        <machine maxCpus='255'>pc-i440fx-1.7</machine>
        <machine maxCpus='288'>pc-q35-2.9</machine>
        <machine maxCpus='255'>pc-0.15</machine>
        <machine maxCpus='255'>pc-i440fx-1.5</machine>
        <machine maxCpus='255'>pc-q35-2.7</machine>
        <machine maxCpus='255'>pc-i440fx-1.6</machine>
        <machine maxCpus='255'>pc-i440fx-2.11</machine>
        <machine canonical='pc-i440fx-2.11' maxCpus='255'>pc</machine>
        <machine maxCpus='288'>pc-q35-2.8</machine>
        <machine maxCpus='288'>pc-q35-zesty</machine>
        <machine maxCpus='255'>pc-0.13</machine>
        <machine maxCpus='288'>pc-q35-artful</machine>
        <machine maxCpus='255'>pc-0.14</machine>
        <machine maxCpus='255'>pc-q35-2.4</machine>
        <machine maxCpus='255'>pc-i440fx-trusty</machine>
        <machine maxCpus='255'>pc-q35-2.5</machine>
        <machine maxCpus='255'>pc-q35-2.6</machine>
        <machine maxCpus='255'>pc-i440fx-1.4</machine>
        <machine maxCpus='255'>pc-i440fx-2.10</machine>
        <machine maxCpus='255'>pc-0.11</machine>
        <machine maxCpus='255'>pc-0.12</machine>
        <machine maxCpus='288'>pc-q35-bionic</machine>
        <machine maxCpus='255'>pc-0.10</machine>
      </domain>
    </arch>
    <features>
      <cpuselection/>
      <deviceboot/>
      <disksnapshot default='on' toggle='no'/>
      <acpi default='on' toggle='yes'/>
      <apic default='on' toggle='no'/>
    </features>
  </guest>

</capabilities>

node2

<capabilities>

  <host>
    <uuid>d53148f5-7cfa-11e0-b91d-001e67130a3c</uuid>
    <cpu>
      <arch>x86_64</arch>
      <model>Nehalem-IBRS</model>
      <vendor>Intel</vendor>
      <microcode version='29'/>
      <topology sockets='1' cores='4' threads='1'/>
      <feature name='vme'/>
      <feature name='ds'/>
      <feature name='acpi'/>
      <feature name='ss'/>
      <feature name='ht'/>
      <feature name='tm'/>
      <feature name='pbe'/>
      <feature name='dtes64'/>
      <feature name='monitor'/>
      <feature name='ds_cpl'/>
      <feature name='vmx'/>
      <feature name='est'/>
      <feature name='tm2'/>
      <feature name='xtpr'/>
      <feature name='pdcm'/>
      <feature name='dca'/>
      <feature name='ssbd'/>
      <feature name='rdtscp'/>
      <feature name='invtsc'/>
      <pages unit='KiB' size='4'/>
      <pages unit='KiB' size='2048'/>
    </cpu>
    <power_management>
      <suspend_mem/>
    </power_management>
    <migration_features>
      <live/>
      <uri_transports>
        <uri_transport>tcp</uri_transport>
        <uri_transport>rdma</uri_transport>
      </uri_transports>
    </migration_features>
    <topology>
      <cells num='1'>
        <cell id='0'>
          <memory unit='KiB'>16364064</memory>
          <pages unit='KiB' size='4'>4091016</pages>
          <pages unit='KiB' size='2048'>0</pages>
          <distances>
            <sibling id='0' value='10'/>
          </distances>
          <cpus num='4'>
            <cpu id='0' socket_id='0' core_id='0' siblings='0'/>
            <cpu id='1' socket_id='0' core_id='1' siblings='1'/>
            <cpu id='2' socket_id='0' core_id='2' siblings='2'/>
            <cpu id='3' socket_id='0' core_id='3' siblings='3'/>
          </cpus>
        </cell>
      </cells>
    </topology>
    <cache>
      <bank id='0' level='3' type='both' size='4' unit='MiB' cpus='0-3'/>
    </cache>
    <secmodel>
      <model>apparmor</model>
      <doi>0</doi>
    </secmodel>
    <secmodel>
      <model>dac</model>
      <doi>0</doi>
      <baselabel type='kvm'>+64055:+114</baselabel>
      <baselabel type='qemu'>+64055:+114</baselabel>
    </secmodel>
  </host>

  <guest>
    <os_type>hvm</os_type>
    <arch name='i686'>
      <wordsize>32</wordsize>
      <emulator>/usr/bin/qemu-system-i386</emulator>
      <machine maxCpus='255'>pc-i440fx-bionic</machine>
      <machine canonical='pc-i440fx-bionic' maxCpus='255'>ubuntu</machine>
      <machine maxCpus='1'>isapc</machine>
      <machine maxCpus='255'>pc-1.1</machine>
      <machine maxCpus='255'>pc-1.2</machine>
      <machine maxCpus='255'>pc-1.3</machine>
      <machine maxCpus='255'>pc-i440fx-zesty</machine>
      <machine maxCpus='255'>pc-i440fx-2.8</machine>
      <machine maxCpus='255'>pc-1.0</machine>
      <machine maxCpus='255'>pc-i440fx-2.9</machine>
      <machine maxCpus='255'>pc-i440fx-2.6</machine>
      <machine maxCpus='255'>pc-i440fx-2.7</machine>
      <machine maxCpus='128'>xenfv</machine>
      <machine maxCpus='255'>pc-i440fx-wily</machine>
      <machine maxCpus='255'>pc-i440fx-2.3</machine>
      <machine maxCpus='255'>pc-i440fx-2.4</machine>
      <machine maxCpus='255'>pc-i440fx-2.5</machine>
      <machine maxCpus='255'>pc-i440fx-yakkety</machine>
      <machine maxCpus='255'>pc-i440fx-2.1</machine>
      <machine maxCpus='255'>pc-i440fx-2.2</machine>
      <machine maxCpus='255'>pc-i440fx-2.0</machine>
      <machine maxCpus='255'>pc-q35-yakkety</machine>
      <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
      <machine maxCpus='288'>pc-q35-2.11</machine>
      <machine canonical='pc-q35-2.11' maxCpus='288'>q35</machine>
      <machine maxCpus='255'>pc-i440fx-xenial</machine>
      <machine maxCpus='1'>xenpv</machine>
      <machine maxCpus='288'>pc-q35-2.10</machine>
      <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
      <machine maxCpus='255'>pc-q35-xenial</machine>
      <machine maxCpus='255'>pc-i440fx-artful</machine>
      <machine maxCpus='255'>pc-i440fx-1.7</machine>
      <machine maxCpus='288'>pc-q35-2.9</machine>
      <machine maxCpus='255'>pc-0.15</machine>
      <machine maxCpus='255'>pc-i440fx-1.5</machine>
      <machine maxCpus='255'>pc-q35-2.7</machine>
      <machine maxCpus='255'>pc-i440fx-1.6</machine>
      <machine maxCpus='255'>pc-i440fx-2.11</machine>
      <machine canonical='pc-i440fx-2.11' maxCpus='255'>pc</machine>
      <machine maxCpus='288'>pc-q35-2.8</machine>
      <machine maxCpus='288'>pc-q35-zesty</machine>
      <machine maxCpus='255'>pc-0.13</machine>
      <machine maxCpus='288'>pc-q35-artful</machine>
      <machine maxCpus='255'>pc-0.14</machine>
      <machine maxCpus='255'>pc-q35-2.4</machine>
      <machine maxCpus='255'>pc-i440fx-trusty</machine>
      <machine maxCpus='255'>pc-q35-2.5</machine>
      <machine maxCpus='255'>pc-q35-2.6</machine>
      <machine maxCpus='255'>pc-i440fx-1.4</machine>
      <machine maxCpus='255'>pc-i440fx-2.10</machine>
      <machine maxCpus='255'>pc-0.11</machine>
      <machine maxCpus='255'>pc-0.12</machine>
      <machine maxCpus='288'>pc-q35-bionic</machine>
      <machine maxCpus='255'>pc-0.10</machine>
      <domain type='qemu'/>
      <domain type='kvm'>
        <emulator>/usr/bin/kvm-spice</emulator>
        <machine maxCpus='255'>pc-i440fx-bionic</machine>
        <machine canonical='pc-i440fx-bionic' maxCpus='255'>ubuntu</machine>
        <machine maxCpus='1'>isapc</machine>
        <machine maxCpus='255'>pc-1.1</machine>
        <machine maxCpus='255'>pc-1.2</machine>
        <machine maxCpus='255'>pc-1.3</machine>
        <machine maxCpus='255'>pc-i440fx-zesty</machine>
        <machine maxCpus='255'>pc-i440fx-2.8</machine>
        <machine maxCpus='255'>pc-1.0</machine>
        <machine maxCpus='255'>pc-i440fx-2.9</machine>
        <machine maxCpus='255'>pc-i440fx-2.6</machine>
        <machine maxCpus='255'>pc-i440fx-2.7</machine>
        <machine maxCpus='128'>xenfv</machine>
        <machine maxCpus='255'>pc-i440fx-wily</machine>
        <machine maxCpus='255'>pc-i440fx-2.3</machine>
        <machine maxCpus='255'>pc-i440fx-2.4</machine>
        <machine maxCpus='255'>pc-i440fx-2.5</machine>
        <machine maxCpus='255'>pc-i440fx-yakkety</machine>
        <machine maxCpus='255'>pc-i440fx-2.1</machine>
        <machine maxCpus='255'>pc-i440fx-2.2</machine>
        <machine maxCpus='255'>pc-i440fx-2.0</machine>
        <machine maxCpus='255'>pc-q35-yakkety</machine>
        <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
        <machine maxCpus='288'>pc-q35-2.11</machine>
        <machine canonical='pc-q35-2.11' maxCpus='288'>q35</machine>
        <machine maxCpus='255'>pc-i440fx-xenial</machine>
        <machine maxCpus='1'>xenpv</machine>
        <machine maxCpus='288'>pc-q35-2.10</machine>
        <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
        <machine maxCpus='255'>pc-q35-xenial</machine>
        <machine maxCpus='255'>pc-i440fx-artful</machine>
        <machine maxCpus='255'>pc-i440fx-1.7</machine>
        <machine maxCpus='288'>pc-q35-2.9</machine>
        <machine maxCpus='255'>pc-0.15</machine>
        <machine maxCpus='255'>pc-i440fx-1.5</machine>
        <machine maxCpus='255'>pc-q35-2.7</machine>
        <machine maxCpus='255'>pc-i440fx-1.6</machine>
        <machine maxCpus='255'>pc-i440fx-2.11</machine>
        <machine canonical='pc-i440fx-2.11' maxCpus='255'>pc</machine>
        <machine maxCpus='288'>pc-q35-2.8</machine>
        <machine maxCpus='288'>pc-q35-zesty</machine>
        <machine maxCpus='255'>pc-0.13</machine>
        <machine maxCpus='288'>pc-q35-artful</machine>
        <machine maxCpus='255'>pc-0.14</machine>
        <machine maxCpus='255'>pc-q35-2.4</machine>
        <machine maxCpus='255'>pc-i440fx-trusty</machine>
        <machine maxCpus='255'>pc-q35-2.5</machine>
        <machine maxCpus='255'>pc-q35-2.6</machine>
        <machine maxCpus='255'>pc-i440fx-1.4</machine>
        <machine maxCpus='255'>pc-i440fx-2.10</machine>
        <machine maxCpus='255'>pc-0.11</machine>
        <machine maxCpus='255'>pc-0.12</machine>
        <machine maxCpus='288'>pc-q35-bionic</machine>
        <machine maxCpus='255'>pc-0.10</machine>
      </domain>
    </arch>
    <features>
      <cpuselection/>
      <deviceboot/>
      <disksnapshot default='on' toggle='no'/>
      <acpi default='on' toggle='yes'/>
      <apic default='on' toggle='no'/>
      <pae/>
      <nonpae/>
    </features>
  </guest>

  <guest>
    <os_type>hvm</os_type>
    <arch name='x86_64'>
      <wordsize>64</wordsize>
      <emulator>/usr/bin/qemu-system-x86_64</emulator>
      <machine maxCpus='255'>pc-i440fx-bionic</machine>
      <machine canonical='pc-i440fx-bionic' maxCpus='255'>ubuntu</machine>
      <machine maxCpus='1'>isapc</machine>
      <machine maxCpus='255'>pc-1.1</machine>
      <machine maxCpus='255'>pc-1.2</machine>
      <machine maxCpus='255'>pc-1.3</machine>
      <machine maxCpus='255'>pc-i440fx-zesty</machine>
      <machine maxCpus='255'>pc-i440fx-2.8</machine>
      <machine maxCpus='255'>pc-1.0</machine>
      <machine maxCpus='255'>pc-i440fx-2.9</machine>
      <machine maxCpus='255'>pc-i440fx-2.6</machine>
      <machine maxCpus='255'>pc-i440fx-2.7</machine>
      <machine maxCpus='128'>xenfv</machine>
      <machine maxCpus='255'>pc-i440fx-wily</machine>
      <machine maxCpus='255'>pc-i440fx-2.3</machine>
      <machine maxCpus='255'>pc-i440fx-2.4</machine>
      <machine maxCpus='255'>pc-i440fx-2.5</machine>
      <machine maxCpus='255'>pc-i440fx-yakkety</machine>
      <machine maxCpus='255'>pc-i440fx-2.1</machine>
      <machine maxCpus='255'>pc-i440fx-2.2</machine>
      <machine maxCpus='255'>pc-i440fx-2.0</machine>
      <machine maxCpus='255'>pc-q35-yakkety</machine>
      <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
      <machine maxCpus='288'>pc-q35-2.11</machine>
      <machine canonical='pc-q35-2.11' maxCpus='288'>q35</machine>
      <machine maxCpus='255'>pc-i440fx-xenial</machine>
      <machine maxCpus='1'>xenpv</machine>
      <machine maxCpus='288'>pc-q35-2.10</machine>
      <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
      <machine maxCpus='255'>pc-q35-xenial</machine>
      <machine maxCpus='255'>pc-i440fx-artful</machine>
      <machine maxCpus='255'>pc-i440fx-1.7</machine>
      <machine maxCpus='288'>pc-q35-2.9</machine>
      <machine maxCpus='255'>pc-0.15</machine>
      <machine maxCpus='255'>pc-i440fx-1.5</machine>
      <machine maxCpus='255'>pc-q35-2.7</machine>
      <machine maxCpus='255'>pc-i440fx-1.6</machine>
      <machine maxCpus='255'>pc-i440fx-2.11</machine>
      <machine canonical='pc-i440fx-2.11' maxCpus='255'>pc</machine>
      <machine maxCpus='288'>pc-q35-2.8</machine>
      <machine maxCpus='288'>pc-q35-zesty</machine>
      <machine maxCpus='255'>pc-0.13</machine>
      <machine maxCpus='288'>pc-q35-artful</machine>
      <machine maxCpus='255'>pc-0.14</machine>
      <machine maxCpus='255'>pc-q35-2.4</machine>
      <machine maxCpus='255'>pc-i440fx-trusty</machine>
      <machine maxCpus='255'>pc-q35-2.5</machine>
      <machine maxCpus='255'>pc-q35-2.6</machine>
      <machine maxCpus='255'>pc-i440fx-1.4</machine>
      <machine maxCpus='255'>pc-i440fx-2.10</machine>
      <machine maxCpus='255'>pc-0.11</machine>
      <machine maxCpus='255'>pc-0.12</machine>
      <machine maxCpus='288'>pc-q35-bionic</machine>
      <machine maxCpus='255'>pc-0.10</machine>
      <domain type='qemu'/>
      <domain type='kvm'>
        <emulator>/usr/bin/kvm-spice</emulator>
        <machine maxCpus='255'>pc-i440fx-bionic</machine>
        <machine canonical='pc-i440fx-bionic' maxCpus='255'>ubuntu</machine>
        <machine maxCpus='1'>isapc</machine>
        <machine maxCpus='255'>pc-1.1</machine>
        <machine maxCpus='255'>pc-1.2</machine>
        <machine maxCpus='255'>pc-1.3</machine>
        <machine maxCpus='255'>pc-i440fx-zesty</machine>
        <machine maxCpus='255'>pc-i440fx-2.8</machine>
        <machine maxCpus='255'>pc-1.0</machine>
        <machine maxCpus='255'>pc-i440fx-2.9</machine>
        <machine maxCpus='255'>pc-i440fx-2.6</machine>
        <machine maxCpus='255'>pc-i440fx-2.7</machine>
        <machine maxCpus='128'>xenfv</machine>
        <machine maxCpus='255'>pc-i440fx-wily</machine>
        <machine maxCpus='255'>pc-i440fx-2.3</machine>
        <machine maxCpus='255'>pc-i440fx-2.4</machine>
        <machine maxCpus='255'>pc-i440fx-2.5</machine>
        <machine maxCpus='255'>pc-i440fx-yakkety</machine>
        <machine maxCpus='255'>pc-i440fx-2.1</machine>
        <machine maxCpus='255'>pc-i440fx-2.2</machine>
        <machine maxCpus='255'>pc-i440fx-2.0</machine>
        <machine maxCpus='255'>pc-q35-yakkety</machine>
        <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
        <machine maxCpus='288'>pc-q35-2.11</machine>
        <machine canonical='pc-q35-2.11' maxCpus='288'>q35</machine>
        <machine maxCpus='255'>pc-i440fx-xenial</machine>
        <machine maxCpus='1'>xenpv</machine>
        <machine maxCpus='288'>pc-q35-2.10</machine>
        <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
        <machine maxCpus='255'>pc-q35-xenial</machine>
        <machine maxCpus='255'>pc-i440fx-artful</machine>
        <machine maxCpus='255'>pc-i440fx-1.7</machine>
        <machine maxCpus='288'>pc-q35-2.9</machine>
        <machine maxCpus='255'>pc-0.15</machine>
        <machine maxCpus='255'>pc-i440fx-1.5</machine>
        <machine maxCpus='255'>pc-q35-2.7</machine>
        <machine maxCpus='255'>pc-i440fx-1.6</machine>
        <machine maxCpus='255'>pc-i440fx-2.11</machine>
        <machine canonical='pc-i440fx-2.11' maxCpus='255'>pc</machine>
        <machine maxCpus='288'>pc-q35-2.8</machine>
        <machine maxCpus='288'>pc-q35-zesty</machine>
        <machine maxCpus='255'>pc-0.13</machine>
        <machine maxCpus='288'>pc-q35-artful</machine>
        <machine maxCpus='255'>pc-0.14</machine>
        <machine maxCpus='255'>pc-q35-2.4</machine>
        <machine maxCpus='255'>pc-i440fx-trusty</machine>
        <machine maxCpus='255'>pc-q35-2.5</machine>
        <machine maxCpus='255'>pc-q35-2.6</machine>
        <machine maxCpus='255'>pc-i440fx-1.4</machine>
        <machine maxCpus='255'>pc-i440fx-2.10</machine>
        <machine maxCpus='255'>pc-0.11</machine>
        <machine maxCpus='255'>pc-0.12</machine>
        <machine maxCpus='288'>pc-q35-bionic</machine>
        <machine maxCpus='255'>pc-0.10</machine>
      </domain>
    </arch>
    <features>
      <cpuselection/>
      <deviceboot/>
      <disksnapshot default='on' toggle='no'/>
      <acpi default='on' toggle='yes'/>
      <apic default='on' toggle='no'/>
    </features>
  </guest>

</capabilities>

attaching text file can be dangerous you can add content with code block (with three apostrophe not one ) ![image](https://user-images.githubusercontent.com/1725643/145572801-4028069c-e90d-422d-bd88-50da5f7b75c2.png) by the way; i guess your problem is related with emulator difference. what the heck is that: /usr/bin/kvm-spiceubuntu kvm 2.11 package has riddiculus addings. can you please change XML manually with/usr/bin/kvm-spiceto/usr/bin/qemu-system-x86_64`

catborise commented 2 years ago

@skyshe did you try migrate after changing "/usr/bin/kvm-spice" to "/usr/bin/qemu-system-x86_64" if it is working we can work on a solution

retspen / webvirtcloud

Destination host emulator is different. Cannot be migrated #465

systemctl status libvirt-bin.service

systemctl status libvirtd.service.service