使用OpenAI format的输入得到的response要如何提取出回复文本，返回的response好像是分段的

InternLM / lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

https://lmdeploy.readthedocs.io/en/latest/

Apache License 2.0

3.11k stars 280 forks source link

Open Yang-bug-star opened 3 days ago

Yang-bug-star commented 3 days ago

而且其生成回复都是英文

QwertyJack commented 2 days ago