search

BerriAI / reliableGPT

Get 100% uptime, reliability from OpenAI. Handle Rate Limit, Timeout, API, Keys Errors
MIT License
623 stars 33 forks source link

Track timeout errors #24

Open ishaan-jaff opened 1 year ago

ishaan-jaff commented 1 year ago

If my responses take more than 10 seconds from Azure OpenAI I want reliableGPT to retry another request to OpenAI. It can try with 2-3 concurrent calls to diff models