search

sul-dlss / libsys-airflow

Airflow DAGS for migrating and managing ILS data into FOLIO along with other LibSys workflows
Apache License 2.0
5 stars 0 forks source link

DAG to remove old archives files #860

Closed jgreben closed 3 months ago

jgreben commented 6 months ago

Daily or weekly, remove archived files older than 30 days.

Is there already something in libsys-airflow that does this? What about the purge_archived_files DAG? Can this be repurposed? There is also the remove_archived_migration_files. Should it be removed?

shelleydoljack commented 6 months ago

Remove files older than 90 days.

Rename the VMA purge_archived_files to something more specific for VMA.

DAG is mainly for data export but should be designed so it can be used for other DAGs' file cleanup.