CDLUC3 / mrt-doc

Documentation and Information regarding the Merritt repository
8 stars 4 forks source link

stage cleanup script to be run weekly #2021

Closed terrywbrady closed 1 month ago

terrywbrady commented 2 months ago

As we ramp up data load testing in stage, David offered to script a weekly cleanup for 3 STAGE collections

We will completely purge the content in each of these 3 collections on a weekly basis to prevent an accumulation of storage costs.

dloy commented 2 months ago

Issue

A large amount of end-to-end regression tests will be run on stage to:

These tests will generate a large amount of content that will require periodic and on-going deletion.

Discussion

Collection

Specific content collection(s) used for this content:

Frequency

This content will most likely be created on an ongoing basis (e.g. triggered daily or more frequently)

Deletion should occur regularly to prevent content of a certain age from remaining on the system.

Validations

Validation checks to confirm that content has successfully been removed form both storage and inv db is critical

Implementation

Steps

Note this process should self correct if deletion is failed.

Manual confirmation