Add a 1 minute retry if rate limitted so execution can run to completion - Githubissues

mshumer / ai-researcher

MIT License

867 stars 95 forks source link

Add a 1 minute retry if rate limitted so execution can run to completion #1

Open MinhNgyuen opened 4 months ago

MinhNgyuen commented 4 months ago

Problem: Execution can grind to a halt midway through if a rate limit is encountered and progress (search and llm usage) will be lost

Solution: If the rate limit is encountered, go to sleep for 1 minute until the tokens per minute rate limit is refreshed.

Testing:

Ran this code
Encountered the rate limit 5+ times
Verified with the print statement that execution went to sleep for 1 minute for the rate limit
Execution progressed as normal after the sleep

Claude rate limits

meetbryce commented 3 months ago

This worked great for me! @mshumer you should totally merge this