search

langtech-bsc / argilla-eval

0 stars 0 forks source link

[Infrastructure] Backup argilla databases #3

Open PaulNdrei opened 3 days ago

PaulNdrei commented 3 days ago

To Argilla deployment to be production ready it need to implement some backup system.

To backup:

PaulNdrei commented 3 days ago

I have already implemented a backup system for both database engines.

For Postgres: https://github.com/eeshugerman/postgres-backup-s3 For ElasticSearch, i have created a fork of eeshugerman/postgres-backup-s3 and adapted it to the need of backuping the multiples indices that Argilla stores.

The fork: https://github.com/langtech-bsc/multi-elasticsearch-backup-s3

Both backup systems are directly integrated into the deployment file (docker-compose)