I have the use case where I'd like to programmatically download outputs to my local machine so that I can analyze the outputs across many jobs. Currently, the CLI option saves to the current directory and it's not straightforward to just dump all the outputs in a target directory because the output.tar file is unzipped.
Seems like it would be a quick solution to add an argument to the data clone command to set untar=False, delete_after_untar=False so that I can just mv the tar file to the target directory and untar it there.
I have the use case where I'd like to programmatically download outputs to my local machine so that I can analyze the outputs across many jobs. Currently, the CLI option saves to the current directory and it's not straightforward to just dump all the outputs in a target directory because the
output.tar
file is unzipped.Seems like it would be a quick solution to add an argument to the data clone command to set
untar=False, delete_after_untar=False
so that I can justmv
the tar file to the target directory and untar it there.