search

percona / pmm

Percona Monitoring and Management: an open source database monitoring, observability and management tool
https://www.percona.com/software/database-tools/percona-monitoring-and-management
GNU Affero General Public License v3.0
671 stars 129 forks source link

Backup doesn't finish and can't be canceled #2696

Open DonMarv00 opened 11 months ago

DonMarv00 commented 11 months ago

Description

I started a backup, and during the process, my MySQL server restarted. Since then, the backup process seems to be stuck in a loop. Restarting PMM (Percona Monitoring and Management) doesn't resolve the issue, and even after an update, the backup process continues to run.

backup_error

Expected Results

Backup will be automatically canceled by pmm

Actual Results

Backup is stuck in a loop, even when I reboot the pmm server or delete the data of the backup on the storage server

Version

First detected on version 2.40.1 also happening in version 2.41.0

Steps to reproduce

Start the backup process, restart your mysql server and check if the backup process is looping

Relevant logs

No logs available since pmm doesn't recognize any error

Code of Conduct

artemgavrilov commented 10 months ago

Hello @MarvinStelter, thank you for report, we are aware about this problem but unfortunately didn't address it yet. You can track this issue progress in this ticket: https://perconadev.atlassian.net/browse/PMM-12474

For now the only way to get rid of hanged backup artifact is to connect to PMM internal database and remove record from artifacts table manually. 😔