search

infiniflow / ragflow

RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.
https://ragflow.io
Apache License 2.0
24.21k stars 2.36k forks source link

How get streaming output, when we introduce local deployed LLM #1132

Open tao2021 opened 5 months ago

tao2021 commented 5 months ago

Describe your problem

如何修改chat_model.py

JinHai-CN commented 5 months ago

We intend to create an international community, so we encourage using English for questions and answers to help others with similar queries.

JinHai-CN commented 5 months ago

Refer to PR #934, chat_streamly in chat_model.py.