djmaze / resticker

Run automatic restic backups via a Docker container.
https://hub.docker.com/r/mazzolino/restic/
Apache License 2.0
512 stars 71 forks source link

Backup fails with large folder #166

Closed Enissay closed 1 year ago

Enissay commented 1 year ago

I have a running instance of resticker which is working fine with small files/folders until I add a big folder to backup then it fails...

See log below:

05/24/2023 5:35:19 PM Checking configured repository '/mnt/restic_backup' ...
05/24/2023 5:35:21 PM Repository found.
05/24/2023 5:35:21 PM 
05/24/2023 5:35:21 PM 
05/24/2023 5:35:21 PM Executing backup on startup ...
05/24/2023 5:35:21 PM Starting Backup at 2023-05-24 17:35:21
05/24/2023 5:35:21 PM open repository
05/24/2023 5:35:23 PM lock repository
05/24/2023 5:35:23 PM no parent snapshot found, will read all files
05/24/2023 5:35:23 PM load index files
05/24/2023 5:35:23 PM start scan on [/mnt/big_folder]
05/24/2023 5:35:23 PM start backup on [/mnt/big_folder]
05/24/2023 5:35:46 PM scan finished in 22.996s: 196267 files, 4.200 GiB
05/24/2023 5:35:48 PM /usr/local/bin/backup: line 65:    43 Killed                  restic --repo="${RESTIC_REPOSITORY}" backup "${backup_args[@]}" "${tag_options[@]}" "${backup_sources[@]}"
05/24/2023 5:35:48 PM Backup failed
05/24/2023 5:35:48 PM Finished backup at 2023-05-24 17:35:48 after 27 seconds

Could it be the argument list which becomes too long ? https://github.com/djmaze/resticker/blob/master/backup#LL65C88-L65C102

Enissay commented 1 year ago

Apparently I was putting very low limits on cpu/ram use for that container. Increasing them solved the issue :x