[perf] - Review what the ChatGPT API rate limits are and batch requests

nearform / reviewbot

A bot to assist with code reviews via AI

Apache License 2.0

25 stars 6 forks source link

[perf] - Review what the ChatGPT API rate limits are and batch requests #18

Open richiemccoll opened 1 year ago

richiemccoll commented 1 year ago

message: 'Rate limit reached for default-gpt-3.5-turbo in organization org-qEBbooKoCQLstLjYs1rbUHfW on requests per min. Limit: 20 / min. Please try again in 3s. Contact support@openai.com if you continue to have issues. Please add a payment method to your account to increase your rate limit. Visit https://platform.openai.com/account/billing to add a payment method.',

simoneb commented 1 year ago

To handle this, in another project we're using python's module https://pypi.org/project/backoff/. Eventually we'll get a paid plan for chatgpt anyway