Clean up after uploading/syncing results

mle-infrastructure / mle-toolbox

Lightweight Tool to Manage Distributed ML Experiments 🛠

https://mle-infrastructure.github.io/mle_toolbox/toolbox/

MIT License

3 stars 1 forks source link

Clean up after uploading/syncing results #32

Closed RobertTLange closed 2 years ago

RobertTLange commented 3 years ago

Currently the .zip files that are generated when sending the experiment directory to GCS are not deleted. They should be though. We also want to delete the directory on the machine, whenever it is either retrieved to a local machine or when it has been uploaded to GCS.

RobertTLange commented 3 years ago

Forgot that there already is a command line option when executing run-experiment --delete_after_upload. Maybe we can simply extend this to also delete the directory and not only the zip?