pulibrary / figgy

Valkyrie-based digital repository backend.
Other
35 stars 4 forks source link

Restrict Ingest of top level shares/directories on Studio Isilon Server #6413

Open kelea99 opened 1 month ago

kelea99 commented 1 month ago

Summary

05/28/2024 a batch ingest of the entirety of studio_new from the studio isilon was caught by @tpendragon and stopped. this causes unplanned work for the team, with cleanup of duplicate files and also delays ingest work for other colleagues due to the workers being shut down.

Proposal: Restrict batch ingest for (at minimum) any/all top tier directories/shares on the studio isilon server:

Idea from @hackartisan : It seems like we currently have no use case for MVW-within-MVW, so we should probably disallow ingesting any directory that contains directories past a certain hierarchical level [CHECK EPHEMERA BULK INGEST]

Impact

Please include hard deadlines, if the exhibit is part of an event, the issue is stopping work, etc.

Priority recommendation

Sudden Priority Justification

Required if "asap" or "within the next 3 weeks" is checked. Add "Sudden Priority" and "Maintenance/Research" labels

Expected behaviour

Actual behaviour

Steps to reproduce behaviour

Screenshots

hackartisan commented 1 month ago

Update: the ingest was triggered on studio_new/DPUL so a top-level restriction wouldn't have prevented this. see also #6414