It takes over 20 minutes for the upload_data.py script to run due to waiting for each dataset to finish uploading and be sent to the archive before starting the next dataset upload.
Can we speed this up by sending all the datasets to be uploaded before being sent to the archive?
Short Description
It takes over 20 minutes for the
upload_data.py
script to run due to waiting for each dataset to finish uploading and be sent to the archive before starting the next dataset upload.Can we speed this up by sending all the datasets to be uploaded before being sent to the archive?
Evidence/Steps to Reproduce
No response
Acceptance Criteria/Expected Behaviour
No response
Details
No response
Resolution
No response