Improve Long-Run Stability for ChatGPT

uezo / aiproxy

🦉AIProxy is a reverse proxy for ChatGPT API that provides monitoring, logging, and filtering requests and responses.

Apache License 2.0

38 stars 1 forks source link

Improve Long-Run Stability for ChatGPT #23

Closed uezo closed 6 months ago

uezo commented 6 months ago

Changed the implementation to generate a new instance of the OpenAI API client for every request. This resolves the problem where shared client instances were causing server request processing failures.