RhodiumGroup / rhg_compute_tools

Tools for using compute.rhg.com and compute.impactlab.org
MIT License
1 stars 4 forks source link

make gsutil cp wrapper to quickly do recursive copy #11

Closed bolliger32 closed 6 years ago

bolliger32 commented 6 years ago

using standard linux filesystems tools with the mounted /gcs volume is very slow for many files. Write a wrapper for gsutil -m cp -r to do this copying much faster