penguineer / HareAIris

A software bridge connecting RabbitMQ to the OpenAI API
MIT License
1 stars 0 forks source link

Send rate-limiting deadlines on a separate queue #13

Open penguineer opened 3 weeks ago

penguineer commented 3 weeks ago

Sending rate-limiting events on a separate queue allows callers to determine the wait times for calls to the agent. This can be incorporated in planning and short-cut schemes.

This is a follow-up to #8 as an additional feature.