Closed william-silversmith closed 3 years ago
CloudFiles with parallel (black) vs gsutil parallel (blue).
time mprof run -C cloudfiles -p 2 cp --progress -r gs://$SOURCE .
time mprof run -C gsutil -m cp -r gs://$SOURCE .
Time: 26 sec vs 137 sec (5.2x) Memory: 292 MB vs 712 MB (2.4x) Disk Space: 280 MB vs 406 MB (1.45x)
Tested on linux without travis and it seemed to work fine. I'm guessing this is a travis problem.
The
cloudfiles
CLI command is now automatically installed with cloud-files.