search

labring / FastGPT

FastGPT is a knowledge-based platform built on the LLMs, offers a comprehensive suite of out-of-the-box capabilities such as data processing, RAG retrieval, and visual AI workflow orchestration, letting you easily develop and deploy complex question-answering systems without the need for extensive setup or configuration.
https://tryfastgpt.ai
Other
17.5k stars 4.7k forks source link

Is it possible to use xinference as the AI ​​dialogue source to achieve local multi-model access? #399

Closed Minamiyama closed 6 months ago

c121914yu commented 1 year ago

可以给oneapi 提feature，只要他们兼容了接口即可。

qinxuye commented 1 year ago

@Minamiyama Do you have interest to submit a PR to add xinference support for FastGPT?

Minamiyama commented 12 months ago

@Minamiyama Do you have interest to submit a PR to add xinference support for FastGPT?

yes, I'd like to ;-p

c121914yu commented 6 months ago

翻一遍PR翻到这个。 感谢xinference支持，我看已经很多人接入了，这周我们补一个完整的接入文档。

wuhuzi commented 6 months ago

@c121914yu Could you help attach the detailed integration document?

c121914yu commented 6 months ago

@c121914yu Could you help attach the detailed integration document?

https://doc.fastai.site/docs/development/custom-models/xinference/