search

Duxiaoman-DI / XuanYuan

轩辕：度小满中文金融对话大模型
1.07k stars 97 forks source link

vllm 推理 #22

Open liuainlp opened 7 months ago

liuainlp commented 7 months ago

vllm推理的时候怎么实现流式输出？