API is returning 429s when the rate-limit has not been reached

[disulliv]

There's 2 rate limiters, one of all APIs, then another for Batch APIs.

• The "all API" rate limiter has a limit of 1000 requests per minute per IP address.
• The "batch API" rate limiter has a limit of 250 requests per minute per IP address.

Sometimes we'll get 429 requests before we hit the limit of 1000 requests per minute, even as low as 200 requests/minute across multiple APIs, need to investigate why.

[lamarrr]

For me to investigate this can you give a clearer description of the issue as I have no idea of the context and which specific APIs

[lamarrr]

I've done some digging and I think it has to do with the environment config. what parameters are you using for your environment config? please post them here. note that it is requests per time-limit window. my guess is that it has been configured incorrectly.

the correct config for your requirements is:

{
"RATE_LIMIT_MAX": 1000,
"RATE_LIMIT_WINDOW": 3600,
"BATCH_RATE_LIMIT_MAX": 250,
"BATCH_RATE_LIMIT_WINDOW": 3600
}