usap-dc-dev / usap-dc-website

repository for usap-dc website. Includes javascript client side app and python/flask server side.
2 stars 0 forks source link

update and streamline to processes and scripts for large dataset archive #35

Open fnitsche2001 opened 8 months ago

fnitsche2001 commented 8 months ago

The current procedure of steps to bag and archive large datasets and make the required entries in the database is quite cumbersome and not all steps work for everybody (access privilege issues?). There seem to be some in between steps that need to be done by hand including final updates to the dataset_archive database table. It would be good to revisit these steps and scripts and to establish a more simple and robust workflow.