[Bug] [Module Name] How to connect LLM deployed by Xinference to DBGPT？ - Githubissues

eosphoros-ai / DB-GPT

AI Native Data App Development framework with AWEL(Agentic Workflow Expression Language) and Agents

http://docs.dbgpt.cn

MIT License

13.7k stars 1.84k forks source link

[Bug] [Module Name] How to connect LLM deployed by Xinference to DBGPT？ #2003

Open yuerf opened 2 months ago

yuerf commented 2 months ago

Search before asking

[X] I had searched in the issues and found no similar issues.

Operating system information

Linux

Python version information

=3.11

DB-GPT version

main

Related scenes

[ ] Chat Data
[ ] Chat Excel
[ ] Chat DB
[ ] Chat Knowledge
[ ] Model Management
[ ] Dashboard
[ ] Plugins

Installation Information

Device information

-

Models information

-

What happened

通过xinference部署了大模型，如何在前端配置调用xinference部署的大模型

What you expected to happen

指导我如何配置，前端或在配置文件里

How to reproduce

-

Additional context

No response

Are you willing to submit PR?

[ ] Yes I am willing to submit a PR!

Aries-ckt commented 1 month ago

/assign @fangyinc

ericzhi123 commented 1 month ago

Xinference挺好用的，希望能增加对Xinference的支持。