abbbi / virtnbdbackup

Backup utility for Libvirt / qemu / kvm supporting incremental and differential backups + instant recovery (agentless).
http://libvirtbackup.grinser.de/
GNU General Public License v3.0
330 stars 46 forks source link

deleteCheckpoint issue #91

Closed cosecit closed 1 year ago

cosecit commented 1 year ago

Hi abbbi

i do an update of RHEL9 (from 9 to 9.1) and a virtnbdbackup update from 1.9.6 tp 1.9.10

sinze the update most of the backup jobs failed.

virtnbdbackup -V 1.9.10

virsh version Compiled against library: libvirt 8.5.0 Using library: libvirt 8.5.0 Using API: QEMU 8.5.0 Running hypervisor: QEMU 7.0.0

virtnbdbackup -d win11-p -l full -o /daten_sich/vm/win11-p [2023-01-03 16:09:46] INFO common - printVersion [MainThread]: Version: 1.9.10 Arguments: virtnbdbackup -d win11-p -l full -o /daten_sich/vm/win11-p [2023-01-03 16:09:46] INFO virtnbdbackup - main [MainThread]: Backup level: [full] [2023-01-03 16:09:46] INFO virtnbdbackup - main [MainThread]: Libvirt library version: [8005000] [2023-01-03 16:09:46] INFO virtnbdbackup - main [MainThread]: Domain has [2] disks attached which support changed block tracking. [2023-01-03 16:09:46] INFO virtnbdbackup - main [MainThread]: Concurrent backup processes: [2] [2023-01-03 16:09:46] INFO client - redefineCheckpoints [MainThread]: Loading checkpoint list from: [/daten_sich/vm/win11-p/checkpoints] [2023-01-03 16:09:46] INFO virtnbdbackup - handleCheckpoints [MainThread]: Checkpoint handling. [2023-01-03 16:09:46] ERROR client - _deleteCheckpoint [MainThread]: Error during checkpoint removal: [internal error: bitmap 'virtnbdbackup.1' not found in backing chain of 'sda'] [2023-01-03 16:09:46] ERROR virtnbdbackup - main [MainThread]: Failed to remove checkpoint.

abbbi commented 1 year ago

Error during checkpoint removal: [internal error: bitmap 'virtnbdbackup.1' not found in backing chain of 'sda'

please use "virsh checkpoint-list" to list checkpoints of that virtual machine. It seems the bitmap information of the qcow files is out of sync with the checkpoint list of libvirt. Use qemu-img to check which bitmaps exist in the virtual machine qcow file. This is not a bug as far as i can see.

cosecit commented 1 year ago

thanks abbbi i see 2 Checkpoints i think from the last backups. Bevor i checked virsh snapshot-list win11-p and deletet the snapshot.

i have the issue on the moust vm´s

virsh checkpoint-list win11-p Name Creation Time

virtnbdbackup.0 2023-01-01 02:12:20 +0100 virtnbdbackup.1 2023-01-02 02:00:08 +0100

virsh checkpoint-delete win11-p virtnbdbackup.1 error: Failed to delete checkpoint virtnbdbackup.1 error: internal error: bitmap 'virtnbdbackup.1' not found in backing chain of 'sda'

in the next maintenance windows i will check the images qemu-img check win11-p.qcow2 qemu-img: Could not open 'win11-p.qcow2': Failed to get shared "write" lock Is another process using the image [win11-p.qcow2]?

abbbi commented 1 year ago

the problem is that your libvirt layer thinks there exist checkpoints, but they are not acutally existant in the qcow image anymore, as it seems. Maybe updating to RHEL9.1 has reset something, i dont know.

use --force-share option to allow fetching information of qcow2 images in use to show the bitmaps that are saved within the qcow image:

qemu-img info /path/to/qcow/file.qcow2 --force-share

And cross check which checkpoitns are listed for the vm:

virsh checkpoint-list <vm-name>

If the list of bitmaps does not match the list of checkpoitns, then remove releated metadata information on libvirt via

virsh checkpoint-delete <checkpoint_name> --metadata

and start with a fresh full backup afterwards.

cosecit commented 1 year ago

thx abbbi it works

abbbi commented 1 year ago

good to hear, consider pressing the sponsor button, thanks