Closed penguineer closed 3 weeks ago
Try to use resilience4j to add simple rate-limiting on serivce calls.
This has still some short-comings and since the OpenAI service gives backpressure information itself, it might be better to use that.
Leaving it as a draft PR for the time being.
Try to use resilience4j to add simple rate-limiting on serivce calls.
This has still some short-comings and since the OpenAI service gives backpressure information itself, it might be better to use that.
Leaving it as a draft PR for the time being.