anvilproject / fs.anvilfs

Apache License 2.0
3 stars 0 forks source link

Google storage batching #13

Closed luke-c-sargent closed 3 years ago

luke-c-sargent commented 3 years ago

batches gs:// requests with python storage.client batch() context.

batches requests in groups of 100; sets a limit for number of requests to even try to batch, since name can be inferred from gs URI