knowledgesystems / pipelines-scrum

Repository for tracking uncategorizable issues related to backend pipelines work
0 stars 0 forks source link

Add git cleanup step to AZ-MSKIMPACT cohort generation #1215

Closed callachennault closed 8 months ago

callachennault commented 10 months ago

Done Condition (What do we need? Why do we need it? Keep this is small as possible!)

AZ repo is growing too large - using over 100 GB on pipelines3. Add a step to clean unneeded lfs objects to the AZ script (reference: https://github.com/knowledgesystems/cmo-pipelines/blob/master/import-scripts/datasource-repo-cleanup.sh) and roll over repo if needed

Technical Description (How are we going to achieve the above)

Potential Issues

Dependencies

Technical Requirements

Outside People/Teams

Changes