Can I access LLM started by fastchat?

[cxj01]

Search before asking

• [X] I had searched in the issues and found no similar issues.

Operating system information

Linux

Python version information

=3.11

DB-GPT version

main

Related scenes

• [X] Chat Data
• [ ] Chat Excel
• [ ] Chat DB
• [ ] Chat Knowledge
• [ ] Model Management
• [ ] Dashboard
• [ ] Plugins

Installation Information

• [X] Installation From Source

• [ ] Docker Installation

• [ ] Docker Compose Installation

• [ ] Cluster Installation

• [ ] AutoDL Image

• [ ] Other

Device information

无

Models information

qwen2

What happened

如何接入使用fastChat部署的LLM，使用其对应的fastapi？

What you expected to happen

如何接入使用fastChat部署的LLM，使用其对应的fastapi？

How to reproduce

如何接入使用fastChat部署的LLM，使用其对应的fastapi？

Additional context

No response

Are you willing to submit PR?

• [ ] Yes I am willing to submit a PR!

[Aries-ckt]

/assign @fangyinc

[github-actions[bot]]

This issue has been marked as stale, because it has been over 30 days without any activity.

[github-actions[bot]]

This issue bas been closed, because it has been marked as stale and there has been no activity for over 7 days.