uga-libraries / hub-monitoring

Scripts for summarizing and validating content on the Digital Production Hub, the UGA Libraries' centralized storage for digital objects that are not suitable for our digital preservation system.
Creative Commons Attribution Share Alike 4.0 International
1 stars 0 forks source link

Save list of CSVs to a text file first #34

Open amhanson9 opened 6 months ago

amhanson9 commented 6 months ago

It takes 10-15 minutes currently to find the paths to all the risk data CSVs. If the script then breaks when it is reading and summarizing that data, it is time consuming to run it again. If this happens regularly, it could save the list of CSV paths to a text file and have the option to read that instead of iterating on the paths.

This may become unnecessary if more consistent directory structure lets us navigate more efficiently.