ztxz16 / fastllm

纯c++的全平台llm加速库,支持python调用,chatglm-6B级模型单卡可达10000+token / s,支持glm, llama, moss基座,手机端流畅运行
Apache License 2.0
3.23k stars 325 forks source link

/api/chat_stream The result returned by postman is empty #432

Open Dong09 opened 4 months ago

Dong09 commented 4 months ago

I use postman to request data to chat_stream interface, and I expected it to be a streaming result, but it was empty. I probed using the debug pattern and found that every chunk in the stream_response has a value, but nothing changes after send. 2024-03-11 17-17-20屏幕截图