Now that gs-fastcopy is released 🎉
…let's use it!
This PR replaces our (now-old) version of read/write with the "Very Official" versions from the library.
Along the way, add guard clauses because we need to, to leverage multiprocessing. We now use multiprocessing in the write operation (upload in chunks vs gcloud storage).
Now that gs-fastcopy is released 🎉 …let's use it!
This PR replaces our (now-old) version of read/write with the "Very Official" versions from the library.
Along the way, add guard clauses because we need to, to leverage multiprocessing. We now use multiprocessing in the write operation (upload in chunks vs gcloud storage).
Fixes #266