❓ [Immich] Backup way too large

Scags104 commented 7 months ago

Immich

name: Question

about: Why is the backup of my immich addon 5GB+ on its own? This is making my nightly backup to GDrive max out on storage as it jumped from 1gb to 7gb per backup.

Initial investigation of backup files for immich addon arent helpful as they all wont extract or open the image and cause an unknown error.

Which addon? Immich

Addon or app? Addon

Describe the solution you'd like Smaller backup size or knowledge that what its backing up can be skipped in the backup since my images are saved and read from NAS. What i dont want is should i need to restore HA, that the link between immich and my NAS no longer functions and i lose my mappings.

alexbelgium commented 7 months ago

Hi, I can exclude them such as machine-learning data but not sure about the impact on restoring a backup!

Scags104 commented 7 months ago

surprised this doesnt live in the postgres db actually. rather lives in the container itself?

see you pushed a commit through already - thank you!

What are your thoughts about the ML directory/db being offset to network storage as well?

alexbelgium commented 7 months ago

I'll push this update once I'll have sorted the upgraded postgresql needed for recent versions

Indeed this lives in the container... Not fully sure why but I don't use the app so can't say for sure ;-) I could check to offset it but then it could add other complexities so I'm not rushing for that either ;-)

Scags104 commented 7 months ago

Updated today. Think there is an issue with the postgres vector version The pgvecto.rs extension version is 0.1.13 instead of 0.1.11. Please run 'DROP EXTENSION IF EXISTS vectors' and switch to 0.1.11, such as with the docker image

alexbelgium commented 7 months ago

Argh… i'll change the postgres add-on but it seems a recipe for failure in the future to have strict version dependencies

Scags104 commented 7 months ago

I hear you.

Unfortunately the issue persists after the update...

alexbelgium commented 7 months ago

No error messages in the add-on log ? This exact command is run in the startup script in the vector.sh script ; thanks!

Scags104 commented 7 months ago

These are my logs. Typically hangs at setting permissions for a bit because I am using the NAS but once it passes that all I see is the following:

` at async NestApplication.init (/app/immich/server/node_modules/@nestjs/core/nest-application.js:100:9) at async NestApplication.listen (/app/immich/server/node_modules/@nestjs/core/nest-application.js:169:33) at async bootstrap (/app/immich/server/dist/immich/main.js:34:20)

Node.js v20.11.0 /app/immich/server/dist/domain/database/database.service.js:47 throw new Error(` ^

Error: The pgvecto.rs extension version is 0.1.13 instead of 0.1.11. Please run 'DROP EXTENSION IF EXISTS vectors' and switch to 0.1.11, such as with the docker image 'tensorchord/pgvecto-rs:pg15-v0.1.11'. at DatabaseService.assertVectors (/app/immich/server/dist/domain/database/database.service.js:47:19) at process.processTicksAndRejections (node:internal/process/task_queues:95:5) at async DatabaseService.init (/app/immich/server/dist/domain/database/database.service.js:32:9) at async AppService.init (/app/immich/server/dist/immich/app.service.js:56:9) at async AppModule.onModuleInit (/app/immich/server/dist/immich/app.module.js:32:9) at async callModuleInitHook (/app/immich/server/node_modules/@nestjs/core/hooks/on-module-init.hook.js:51:9) at async NestApplication.callInitHook (/app/immich/server/node_modules/@nestjs/core/nest-application-context.js:223:13) at async NestApplication.init (/app/immich/server/node_modules/@nestjs/core/nest-application.js:100:9) at async NestApplication.listen (/app/immich/server/node_modules/@nestjs/core/nest-application.js:169:33) at async bootstrap (/app/immich/server/dist/immich/main.js:34:20)