There is already a rate limiter imposed by openai on the organization level. It depends on the tier we are in. Currently we are on the usage tier 1. More about this can be found here.
We need to consider error mitigating to avoid/recover from rate limiting errors
There is already a rate limiter imposed by openai on the organization level. It depends on the tier we are in. Currently we are on the usage tier 1. More about this can be found here.
We need to consider error mitigating to avoid/recover from rate limiting errors