Open M-Welsch opened 5 months ago
there seems to be a problem with cp -al ...
in combination with rsync -avh ...
cp -al ..
then rsync -avh ...
regardless of smb or ssh (maybe even rsync daemon)cp -al
, but directly overwrting with rsync -avh
cp -al ..
, then rsync -av ..
(no -h
parameter .. or no -a
. There was something with the params)need to verify
surprise, no further details :)
rsync preserves timestamps and everything. It seems to copy whole files if the timestamp doesn't match.
$mkdir backup
$rsync_sink cp ~/Base/Literatur/. backup -r
rsync -avh ~/Base/Literatur/. backup --stats # transfers everything
rsync -avh ~/Base/Literatur/. backup --stats # transfers nothing
why? Let's see ...
after running rsync -avh ..
for the first time, the timestamps have been updated. cp -a ...
preserves everything. New try:
$cp ~/Base/Literatur/. backup -ra
$rsync -avh ~/Base/Literatur/. backup --stats
Number of regular files transferred: 0
Total file size: 39,25M bytes
Able to reproduce, let's see if that is the actual issue. Running a backup until we reach relevant data and see if there's a mismatch in permissions, user, time or whatever ...
hdd/nextcloud/martha/files/The Thing/2sort/2023-04-22-13-57-47-318.jpg
letting rsync run over this directory
timestamps have an hour offset, but are otherwise in sync (because server has a different time zone .. didnt fix that)
Describe the bug
Backup takes longer than expected
Expected behavior
A weekly backup should take a few hours at most (gut feeling).
Actual behavior
Some backups take a whole day.
What happens if we don't solve it (aka why is it important)
long on-times with
To Reproduce
see https://github.com/M-Welsch/backup-server/issues/46#issuecomment-2227293940. Further investigation necesssary
Additional context, Environment
Add any other context about the problem here.
Describe/define the problem
Problem seems to be that full backups are performed instead of increments. BaSe transfers much more data than necessary
Develop Interim Containment Plan (if necessary)
As of now two possiblities:
cp -al ...
rsync -av ...
orrsync -hv ...
not sure whichDetermine Root Causes and Escape Points
Pointer to the solution
Actions to prevent recurrence or solve systematic problems