zilliztech / GPTCache

Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
https://gptcache.readthedocs.io
MIT License
7.06k stars 500 forks source link

[Enhancement]:support Azure Open AI #506

Closed Zhuyaguang782126 closed 1 year ago

Zhuyaguang782126 commented 1 year ago

What would you like to be added?

支持 Azure Open AI

Why is this needed?

国内访问 open AI 不太方便,目前 Azure Open AI 没有此类限制

Anything else?

No response

SimFG commented 1 year ago

It can be used only by modifying the variables in the openai package, and I understand that no additional support is required. Reference: https://learn.microsoft.com/en-us/azure/ai-services/openai/how-to/switching-endpoints

Zhuyaguang782126 commented 1 year ago

yes , i add some code ,it works

image

SimFG commented 1 year ago

Welcome to contribute a pr for this improvement