Open LiMinghan1220 opened 1 week ago
Bot detected the issue body's language is not English, translate it automatically.
Title: [Feature Request] Add custom model service provider
Model compatible with customization
It is hoped that the model service provider can enable users to open more OpenAI-compatible models to use incompatible models (step stars, etc.).
No response
是的,这个功能十分重要,可以添加第三方的接口和API Key,更加灵活。
Bot detected the issue body's language is not English, translate it automatically.
Yes, this function is very important. You can add third-party interfaces and API Keys to make it more flexible.
这个其实在 #5001 处理自定义模型的功能的时候,就有想过。
大致的想法是:
provider
有type
和name
type
可以使用不同的name
定义多个服务商(例如多个中转服务商的情况)model
@providerName
指定不同服务商(使用不同的api_key和api_base)providerType
找到相应的处理逻辑。Bot detected the issue body's language is not English, translate it automatically.
I actually thought about this when #5001 was dealing with the function of custom models.
The general idea is:
provider
has type
and name
type
, you can use different name
to define multiple service providers (such as the case of multiple transit service providers)model
@providerName
specifies different service providers (using different api_key and api_base)providerType
.
🥰 需求描述
模型兼容自定义
🧐 解决方案
希望在模型服务商可使用户自行可多开几个兼容OpenAI的以使用未兼容模型(阶跃星辰等)。
📝 补充信息
No response