uezo / aiproxy

🦉AIProxy is a reverse proxy for ChatGPT API that provides monitoring, logging, and filtering requests and responses.
Apache License 2.0
38 stars 1 forks source link

Prevent excessive retries #7

Closed uezo closed 8 months ago

uezo commented 8 months ago

Reduce excessive retry attempts by setting the default retry count to 0 for HTTP 500-series errors, preventing retries in both the client application and the proxy side.

If you do not want to retry on the proxy side, please set the maximum retry count using the max_retries parameter when instantiating the proxy.