IronCoreLabs / ironhide

Tool to easily encrypt and decrypt files to users and groups. Similar to GPG, but usable at scale.
GNU Affero General Public License v3.0
44 stars 6 forks source link

Batch up multiple file requests to limit number of concurrent API requests #6

Closed ernieturner closed 4 years ago

ernieturner commented 5 years ago

We currently have a limit within IronHide to restrict users from only performing operations on at most 75 files at a time (encrypt/decrypt/grant/revoke/info). This limit is fairly arbitrary but was meant to prevent thrashing the server and potentially getting the user into a Cloudflare rate limiting state. A better solution would be to batch up these requests and perform then in 10-file batches at a time before processing the next batch.