search

LINBIT / linstor-server

High Performance Software-Defined Block Storage for container, cloud and virtualisation. Fully integrated with Docker, Kubernetes, Openstack, Proxmox etc.
https://docs.linbit.com/docs/linstor-guide/
GNU General Public License v3.0
984 stars 76 forks source link

snapshot by backup not working #425

Open jesulo opened 1 month ago

jesulo commented 1 month ago

snapshot by backup not working

... INFO: starting new backup job: vzdump 101 --mode snapshot --notification-mode auto --node proxmox1 --storage PBS --notes-template '{{guestname}}' --remove 0 INFO: Starting Backup of VM 101 (lxc) INFO: Backup started at 2024-10-18 18:30:08 INFO: status = running INFO: CT Name: docker INFO: including mount point rootfs ('/') in backup INFO: backup mode: snapshot INFO: ionice priority: 7 INFO: create storage snapshot 'vzdump' INFO: cleanup temporary 'vzdump' snapshot ERROR: Backup of VM 101 failed - API Return-Code: 500. Message: Could not restore snapshot snap_pm-6ae4d75b_vzdump of pm-6ae4d75b to new snap_pm-6ae4d75b_vzdump, because: ERROR: [{"ret_code":-4611686018407202610,"message":"Not enough free space available for volume 0 of resource 'snap_pm-6ae4d75b_vzdump'.","details":"Resource: snap_pm-6ae4d75b_vzdump","error_report_ids":["6712BBF1-00000-000005"],"obj_refs":{"RscDfn":"snap_pm-6ae4d75b_vzdump"},"created_at":"2024-10-18T18:30:09.252863712-03:00"}] ERROR: at /usr/share/perl5/PVE/Storage/Custom/LINSTORPlugin.pm line 550. ERROR: PVE::Storage::Custom::LINSTORPlugin::activate_volume("PVE::Storage::Custom::LINSTORPlugin", "linstor_storage", HASH(0x5b5f5f2fe130), "pm-6ae4d75b_101", "vzdump", HASH(0x5b5f5f2e2148)) called at /usr/share/perl5/PVE/Storage.pm line 1237 ERROR: PVE::Storage::activate_volumes(HASH(0x5b5f5886d338), ARRAY(0x5b5f5f395128), "vzdump") called at /usr/share/perl5/PVE/VZDump/LXC.pm line 241 ERROR: PVE::VZDump::LXC::snapshot(PVE::VZDump::LXC=HASH(0x5b5f5f2ee9b8), HASH(0x5b5f5f26d0d8), 101) called at /usr/share/perl5/PVE/VZDump.pm line 1162 ERROR: eval {...} called at /usr/share/perl5/PVE/VZDump.pm line 940 ERROR: PVE::VZDump::exec_backup_task(PVE::VZDump=HASH(0x5b5f5717b990), HASH(0x5b5f5f26d0d8)) called at /usr/share/perl5/PVE/VZDump.pm line 1409 ERROR: eval {...} called at /usr/share/perl5/PVE/VZDump.pm line 1404 ERROR: PVE::VZDump::exec_backup(PVE::VZDump=HASH(0x5b5f5717b990), PVE::RPCEnvironment=HASH(0x5b5f58873a00), "root\@pam") called at /usr/share/perl5/PVE/API2/VZDump.pm line 142 ERROR: PVE::API2::VZDump::ANON("UPID:proxmox1:0008F2E9:009A4015:6712D360:vzdump:101:root\@pam:") called at /usr/share/perl5/PVE/RESTEnvironment.pm line 620 ERROR: eval {...} called at /usr/share/perl5/PVE/RESTEnvironment.pm line 611 ERROR: PVE::RESTEnvironment::fork_worker(PVE::RPCEnvironment=HASH(0x5b5f58873a00), "vzdump", 101, "root\@pam", CODE(0x5b5f5f2ee688)) called at /usr/share/perl5/PVE/API2/VZDump.pm line 166 ERROR: PVE::API2::VZDump::ANON(HASH(0x5b5f5f300158)) called at /usr/share/perl5/PVE/RESTHandler.pm line 499 ERROR: PVE::RESTHandler::handle("PVE::API2::VZDump", HASH(0x5b5f5dc7e638), HASH(0x5b5f5f300158)) called at /usr/share/perl5/PVE/HTTPServer.pm line 180 ERROR: eval {...} called at /usr/share/perl5/PVE/HTTPServer.pm line 141 ERROR: PVE::HTTPServer::rest_handler(PVE::HTTPServer=HASH(0x5b5f57160eb8), "::ffff:192.168.100.85", "POST", "/nodes/proxmox1/vzdump", HASH(0x5b5f5f2ef138), HASH(0x5b5f5f2fe2f8), "extjs") called at /usr/share/perl5/PVE/APIServer/AnyEvent.pm line 938 ERROR: eval {...} called at /usr/share/perl5/PVE/APIServer/AnyEvent.pm line 912 ERROR: PVE::APIServer::AnyEvent::handle_api2_request(PVE::HTTPServer=HASH(0x5b5f57160eb8), HASH(0x5b5f57bf9510), HASH(0x5b5f5f2ef138), "POST", "/api2/extjs/nodes/proxmox1/vzdump") called at /usr/share/perl5/PVE/APIServer/AnyEvent.pm line 1162 ERROR: eval {...} called at /usr/share/perl5/PVE/APIServer/AnyEvent.pm line 1154 ERROR: PVE::APIServer::AnyEvent::handle_request(PVE::HTTPServer=HASH(0x5b5f57160eb8), HASH(0x5b5f57bf9510), HASH(0x5b5f5f2ef138), "POST", "/api2/extjs/nodes/proxmox1/vzdump") called at /usr/share/perl5/PVE/APIServer/AnyEvent.pm line 1622 ERROR: PVE::APIServer::AnyEvent::ANON(AnyEvent::Handle=HASH(0x5b5f5f26d8d0), "notes-template=%7B%7Bguestname%7D%7D&remove=0&mode=snapshot&v"...) called at /usr/lib/x86_64-linux-gnu/perl5/5.36/AnyEvent/Handle.pm line 1505 ERROR: AnyEvent::Handle::ANON(AnyEvent::Handle=HASH(0x5b5f5f26d8d0)) called at /usr/lib/x86_64-linux-gnu/perl5/5.36/AnyEvent/Handle.pm line 1315 ERROR: AnyEvent::Handle::_drain_rbuf(AnyEvent::Handle=HASH(0x5b5f5f26d8d0)) called at /usr/lib/x86_64-linux-gnu/perl5/5.36/AnyEvent/Handle.pm line 2015 ERROR: AnyEvent::Handle::ANON() called at /usr/lib/x86_64-linux-gnu/perl5/5.36/AnyEvent/Loop.pm line 248 ERROR: AnyEvent::Loop::one_event() called at /usr/lib/x86_64-linux-gnu/perl5/5.36/AnyEvent/Impl/Perl.pm line 46 ERROR: AnyEvent::CondVar::Base::_wait(AnyEvent::CondVar=HASH(0x5b5f58848798)) called at /usr/lib/x86_64-linux-gnu/perl5/5.36/AnyEvent.pm line 2034 ERROR: AnyEvent::CondVar::Base::recv(AnyEvent::CondVar=HASH(0x5b5f58848798)) called at /usr/share/perl5/PVE/APIServer/AnyEvent.pm line 1936 ERROR: PVE::APIServer::AnyEvent::run(PVE::HTTPServer=HASH(0x5b5f57160eb8)) called at /usr/share/perl5/PVE/Service/pvedaemon.pm line 52 ERROR: PVE::Service::pvedaemon::run(PVE::Service::pvedaemon=HASH(0x5b5f5ed6b9d0)) called at /usr/share/perl5/PVE/Daemon.pm line 171 ERROR: eval {...} called at /usr/share/perl5/PVE/Daemon.pm line 171 ERROR: PVE::Daemon::ANON(PVE::Service::pvedaemon=HASH(0x5b5f5ed6b9d0)) called at /usr/share/perl5/PVE/Daemon.pm line 390 ERROR: eval {...} called at /usr/share/perl5/PVE/Daemon.pm line 379 ERROR: PVE::Daemon::ANON(PVE::Service::pvedaemon=HASH(0x5b5f5ed6b9d0), undef) called at /usr/share/perl5/PVE/Daemon.pm line 551 ERROR: eval {...} called at /usr/share/perl5/PVE/Daemon.pm line 549 ERROR: PVE::Daemon::start(PVE::Service::pvedaemon=HASH(0x5b5f5ed6b9d0), undef) called at /usr/share/perl5/PVE/Daemon.pm line 659 ERROR: PVE::Daemon::ANON(HASH(0x5b5f5715a5c0)) called at /usr/share/perl5/PVE/RESTHandler.pm line 499 ERROR: PVE::RESTHandler::handle("PVE::Service::pvedaemon", HASH(0x5b5f5ed6bd18), HASH(0x5b5f5715a5c0), 1) called at /usr/share/perl5/PVE/RESTHandler.pm line 985 ERROR: eval {...} called at /usr/share/perl5/PVE/RESTHandler.pm line 968 ERROR: PVE::RESTHandler::cli_handler("PVE::Service::pvedaemon", "pvedaemon start", "start", ARRAY(0x5b5f57181610), ARRAY(0x5b5f5717ada8), undef, undef, undef) called at /usr/share/perl5/PVE/CLIHandler.pm line 594 ERROR: PVE::CLIHandler::ANON(ARRAY(0x5b5f5715a788), CODE(0x5b5f5756c2d8), undef) called at /usr/share/perl5/PVE/CLIHandler.pm line 673 ERROR: PVE::CLIHandler::run_cli_handler("PVE::Service::pvedaemon", "prepare", CODE(0x5b5f5756c2d8)) called at /usr/bin/pvedaemon line 27 INFO: Failed at 2024-10-18 18:30:09 INFO: Backup job finished with errors INFO: notified via target mail-to-root TASK ERROR: job errors

......

root@proxmox1:~# linstor resource-definition list ╭────────────────────────────────────────────────────────╮ ┊ ResourceName ┊ Port ┊ ResourceGroup ┊ State ┊ ╞════════════════════════════════════════════════════════╡ ┊ pm-0eab8f54 ┊ 7003 ┊ pve-rg ┊ ok ┊ ┊ pm-6ae4d75b ┊ 7001 ┊ pve-rg ┊ ok ┊ ┊ pm-29f59fec ┊ 7000 ┊ pve-rg ┊ ok ┊ ┊ pm-c8fc495f ┊ 7002 ┊ pve-rg ┊ ok ┊ ┊ snap_pm-6ae4d75b_vzdump ┊ ┊ DfltRscGrp ┊ ok ┊

ghernadi commented 1 month ago

Hello,

from this excerpt: 

ERROR: [{"ret_code":-4611686018407202610,"message":"Not enough free space available for volume 0 of resource 'snap_pm-6ae4d75b_vzdump'.","details":"Resource: snap_pm-6ae4d75b_vzdump","error_report_ids":["6712BBF1-00000-000005"]

Can you verify if you have enough space in the storage pool(s)?

jesulo commented 1 month ago

I have 300gb free but I still can't do the backup, but with a VM that weighs 330gb I can do it. Maybe it's because for an lxc container the same disk space that it occupies is needed free? Because the container contains 500gb although it only has 80gb used internally, and they are in Zfs