search

mshumer / gpt-author

MIT License
2.45k stars 354 forks source link

Rate Limit Issue 10KTPM-200RPM #13

Open kryptobaseddev opened 1 year ago

kryptobaseddev commented 1 year ago

Looking to make some adjustments to create a wait loop to check based on Rate Limit for the specific models. I have been getting an issue when trying to run and hit the limits.

If we can incorporate a way to put a wait/pause loop type check for this type of error so the notebook can continue without failing when hitting the limit.

I will be testing some options but wanted to start this thread to get others input.

ipropheti commented 10 months ago

I tried forking and playing around with this. But I had a few options - ratelimit works, also chunking the request certainly helps.