Add Support for OpenAI - Githubissues

simonkurtz-MSFT / python-openai-loadbalancer

Smart Python OpenAI Load Balancer using priority endpoints and request retries. | Python package at link below:

MIT License

11 stars 0 forks source link

Open simonkurtz-MSFT opened 6 months ago

simonkurtz-MSFT commented 6 months ago

Currently, the code only targets Azure OpenAI. It would be great to also cover OpenAI scenarios.