IDR / deployment

Deployment infrastructure for the Image Data Resource
https://idr.openmicroscopy.org/about/deployment.html
BSD 2-Clause "Simplified" License
13 stars 14 forks source link

Improve DB archiving playbook by using parallel dump #323

Closed sbesson closed 3 years ago

sbesson commented 3 years ago

The DB bump has been quite reliably the bottleneck of the decommissioning process. This tries to enable parallel dump using the directory format

sbesson commented 3 years ago

The execution of the last state of the archive-db.yml playbook (8 parallel threads) on prod94-database completed in 36min split into:

Given the limited gain in terms of disk space, I would consider stopping at the first step and use the directory structure.

sbesson commented 3 years ago

Used for decommissioning prod94