search

infiniflow / ragflow

RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.
https://ragflow.io
Apache License 2.0
21.56k stars 2.11k forks source link

[Question]: Streaming reesponse it not working #857

Closed maxisvest closed 5 months ago

maxisvest commented 5 months ago

Describe your problem

I have upgrade to v0.6.0, but stream response is not working, It is stuck on 'seaching'， when completion api return, the response appear suddenly. I have check the competion api, it works fine, and I also check the console output, It has a warning log which I suspect the cause.

llm model is zhipu gm-4

completion api output image

chrome console output image

KevinHuSh commented 5 months ago

It might related to your local WAN envirement.

maxisvest commented 5 months ago

It might related to your local WAN envirement.

I have solve this problem, turn off the nginx config proxy_buffering, thx.