search

dguerri / LibVirtKvm-scripts

Libvirt/KVM scripts - online forward incremental backup for libvirt/KVM virtual machines
GNU General Public License v3.0
72 stars 25 forks source link

consolidation fails: "numerical result out of range" #50

Closed MaxiReglisse closed 2 years ago

MaxiReglisse commented 2 years ago

I have been using fi-backup for several years, to manage fifty VMs, I find the product very reliable but I encountered an error today that I do not understand.

consolidation of a VM fails with the following message: 

VIRSH : /usr/bin/virsh -q blockcommit themawebprod /var/lib/libvirt/images/themawebprod.bimg-20220130-011709 --wait --pivot --active
[ERR] Error consolidating block device '/var/lib/libvirt/images/themawebprod.bimg-20220130-011709' for 'themawebprod':
 error: No complete monitor response found in 10485760 bytes: Numerical result out of range

the last successful consolidation dates from January 26, 7:20 am. it contains the following 4 virtual disks:

root@kvm2540:~ # ls -lthr /var/lib/libvirt/images/themawebprod*
-rw------- 1 libvirt-qemu kvm  28G Jan 26 07:20 /var/lib/libvirt/images/themawebprod-2.qcow2
-rw------- 1 libvirt-qemu kvm  21G Jan 26 07:20 /var/lib/libvirt/images/themawebprod-3.qcow2
-rw------- 1 libvirt-qemu kvm  49G Jan 26 07:20 /var/lib/libvirt/images/themawebprod-1.qcow2
-rwxr-xr-x 1 libvirt-qemu kvm  18G Jan 26 07:20 /var/lib/libvirt/images/themawebprod.qcow2*

since then, hourly snapshots (bimg) have been piling up and daily consolidation has failed.

-rw------- 1 libvirt-qemu kvm 157M Jan 26 08:16 /var/lib/libvirt/images/themawebprod.bimg-20220126-072049
-rw------- 1 libvirt-qemu kvm 1.2M Jan 26 08:16 /var/lib/libvirt/images/themawebprod-1.bimg-20220126-072049
-rw------- 1 libvirt-qemu kvm 8.6M Jan 26 08:16 /var/lib/libvirt/images/themawebprod-3.bimg-20220126-072049
-rw------- 1 libvirt-qemu kvm 2.5M Jan 26 08:17 /var/lib/libvirt/images/themawebprod-2.bimg-20220126-072049
-rw------- 1 libvirt-qemu kvm 4.9M Jan 26 09:16 /var/lib/libvirt/images/themawebprod-2.bimg-20220126-081704
-rw------- 1 libvirt-qemu kvm 152M Jan 26 09:16 /var/lib/libvirt/images/themawebprod.bimg-20220126-081704
-rw------- 1 libvirt-qemu kvm 1.3M Jan 26 09:16 /var/lib/libvirt/images/themawebprod-1.bimg-20220126-081704
-rw------- 1 libvirt-qemu kvm 8.9M Jan 26 09:16 /var/lib/libvirt/images/themawebprod-3.bimg-20220126-081704
...
-rw------- 1 libvirt-qemu kvm 3.5M Jan 30 01:14 /var/lib/libvirt/images/themawebprod-2.bimg-20220130-001709
-rw------- 1 libvirt-qemu kvm 151M Jan 30 01:17 /var/lib/libvirt/images/themawebprod.bimg-20220130-001709
-rw------- 1 libvirt-qemu kvm 1.2M Jan 30 01:17 /var/lib/libvirt/images/themawebprod-1.bimg-20220130-001709
-rw------- 1 libvirt-qemu kvm 8.4M Jan 30 01:17 /var/lib/libvirt/images/themawebprod-3.bimg-20220130-001709
-rw------- 1 libvirt-qemu kvm  49M Jan 30 11:34 /var/lib/libvirt/images/themawebprod-2.bimg-20220130-011709
-rw------- 1 libvirt-qemu kvm 8.0M Jan 30 11:50 /var/lib/libvirt/images/themawebprod-1.bimg-20220130-011709
-rw------- 1 libvirt-qemu kvm 336M Jan 30 11:50 /var/lib/libvirt/images/themawebprod.bimg-20220130-011709
-rw------- 1 libvirt-qemu kvm  73M Jan 30 11:50 /var/lib/libvirt/images/themawebprod-3.bimg-20220130-011709

so what's going on? I don't know where to look...

Thanks in advance!

Ernest.

MaxiReglisse commented 2 years ago

everyone knows that you have to restart the libvirt/kvm hypervisor when the VMs behave abnormally... so that's what I did, and everything was back to normal! the consolidation was completed without error.

root@kvm2540:~ # ls -ltrh /var/lib/libvirt/images/themawebprod*
-rw------- 1 libvirt-qemu kvm 28G janv. 30 12:37 /var/lib/libvirt/images/themawebprod-2.qcow2
-rw------- 1 libvirt-qemu kvm 49G janv. 30 12:38 /var/lib/libvirt/images/themawebprod-1.qcow2
-rwxr-xr-x 1 libvirt-qemu kvm 18G janv. 30 12:38 /var/lib/libvirt/images/themawebprod.qcow2*
-rw------- 1 libvirt-qemu kvm 21G janv. 30 12:38 /var/lib/libvirt/images/themawebprod-3.qcow2

i am happy!