Hack to reduce rate limit flakiness

VRSEN / agency-swarm

The only reliable agent framework built on top of the latest OpenAI Assistants API.

https://vrsen.github.io/agency-swarm/

MIT License

2.74k stars 727 forks source link

Hack to reduce rate limit flakiness #159

Closed Jocce-Nilsson closed 4 months ago

Jocce-Nilsson commented 4 months ago

I often run into the system crashing due to OpenAI rate limit. With this change, the program halts for 30 seconds and then resumes - instead of hard crash.

Note: This is a hack based on my limited experience of the platform. I suggest the reviewer considers alternative solutions first.

Jocce-Nilsson commented 4 months ago

It only helped temporarily :( Closing PR as the problem remains