search

jackschedel / KoalaClient

The best LLM API Playground Interface (for me)
https://client.koaladev.io/
Creative Commons Zero v1.0 Universal
32 stars 8 forks source link

support azure-openai gpt-35-turbo models #104

Closed fcakyon closed 9 months ago

fcakyon commented 10 months ago

Hey @jackschedel !

Thanks for the awesome repo!

Azure Openai models are named as 'gpt-35-turbo-1106' instead of 'gpt-3.5-turbo-1106'. Could you add a mapping for azure endpoints by checking the endpoint URL? Azure endpoints are in this format: 'https://DEPLOYMENT-NAME.openai.azure.com/'.

Something like this would work: if 'openai.azure.com' in endpoint_url, change 'gpt-3.5-turbo-1106' to 'gpt-35-turbo-1106'.

Bests

jackschedel commented 10 months ago

Thanks for the kind words. Actually already working on implementing custom model names + endpoint formats as of a few days ago xD

fcakyon commented 10 months ago

Thanks for the kind words. Actually already working on implementing custom model names + endpoint formats as of a few days ago xD

Glad to hear! Will be waiting curiously 👀

fcakyon commented 10 months ago

@jackschedel any update on this? :)

jackschedel commented 10 months ago

@fcakyon still in progress. Development is occuring on the 2.1.0 branch.

jackschedel commented 9 months ago

In 2.1.0, you can custom-define model names + endpoints :)