studentenportal / deploy

:ship: The studentenportal.ch deployment
https://studentenportal.ch
0 stars 0 forks source link

duply fails to upload backups #33

Open The-Compiler opened 1 year ago

The-Compiler commented 1 year ago
---> PRET STOR duply-studentenportal/duplicity-full.20230219T230027Z.vol58.difftar.gpg
<--- 200 Ready to proceed
---> PASV
<--- 227 Entering Passive Mode (217,26,54,21,129,172)
---- Connecting data socket to (217.26.54.21) port 33196
---- Data connection established
---> ALLO 209744669
<--- 200 A L'HUILE
---> REST 106438092
<--- 350 Restarting at 106438092
---> STOR duply-studentenportal/duplicity-full.20230219T230027Z.vol58.difftar.gpg
<--- 150 Accepted data connection
<--- 451-Error during write to file
<--- 451-Transfer aborted
<--- 451 0.008 seconds (measured here), 11.97 Mbytes per second
---- Closing data socket
---> SIZE duply-studentenportal/duplicity-full.20230219T230027Z.vol58.difftar.gpg
<--- 213 106438092
copy: put rolled back to 106730600, seeking get accordingly
copy: put rolled back to 106438092, seeking get accordingly
put: /tmp/duplicity-IQQwgQ-tempdir/mktemp-gmO0fM-4: Fatal error: max-retries exceeded
---> QUIT
<--- 221-Goodbye. You uploaded 134571 and downloaded 0 kbytes.
<--- 221 Logout.
---- Closing control socket

no clue why yet... doesn't seem like we're out of space?!

The-Compiler commented 1 year ago

Well, turns out we did run out of space, and FTP is just horrible at error reporting. While the "200 A L'HUILE" as response to "ALLO" was funny, it could've told us it can't allocate that much space instead... :upside_down_face:

We currently run duply weekly with:

MAX_AGE=6M
MAX_FULLBKP_AGE=2M
DUPL_PARAMS="$DUPL_PARAMS --full-if-older-than $MAX_FULLBKP_AGE " 

which means we're currently storing around 44 GB of data:

Last full backup date: Mon Feb 20 00:00:27 2023
There are backup set(s) at time(s):
Mon Aug 15 00:00:35 2022
Mon Aug 22 00:00:14 2022
Mon Aug 29 00:00:19 2022
Mon Sep  5 00:00:08 2022
Mon Sep 12 00:00:10 2022
Mon Sep 19 00:00:10 2022
Mon Sep 26 00:00:27 2022
Mon Oct  3 00:00:12 2022
Which can't be deleted because newer sets depend on them.
No old backup sets found, nothing deleted.
dbrgn commented 1 year ago
---> ALLO 209744669
<--- 200 A L'HUILE

😂😂

Strong https://www.youtube.com/watch?v=QSo0duY7-9s vibes.