feat(cli): added cp, ls, and license commands

seung-lab / cloud-files

Threaded Python and CLI client library for AWS S3, Google Cloud Storage (GCS), in-memory, and the local filesystem.

BSD 3-Clause "New" or "Revised" License

38 stars 8 forks source link

Closed william-silversmith closed 3 years ago

william-silversmith commented 3 years ago

The cloudfiles CLI command is now automatically installed with cloud-files.

william-silversmith commented 3 years ago

CloudFiles with parallel (black) vs gsutil parallel (blue).

time mprof run -C cloudfiles -p 2 cp --progress -r gs://$SOURCE . time mprof run -C gsutil -m cp -r gs://$SOURCE .

Time: 26 sec vs 137 sec (5.2x) Memory: 292 MB vs 712 MB (2.4x) Disk Space: 280 MB vs 406 MB (1.45x)

william-silversmith commented 3 years ago

Tested on linux without travis and it seemed to work fine. I'm guessing this is a travis problem.