seung-lab / cloud-files

Threaded Python and CLI client library for AWS S3, Google Cloud Storage (GCS), in-memory, and the local filesystem.
BSD 3-Clause "New" or "Revised" License
38 stars 8 forks source link

perf: gs and s3 use batch submission for delete (and exists too for gcs) #13

Closed william-silversmith closed 4 years ago

william-silversmith commented 4 years ago

Looks like s3 has this too: https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/s3.html#S3.Bucket.delete_objects