search

dissorial / doc-chatbot

Document chatbot — multiple files, topics, chat windows and chat history. Powered by GPT.
824 stars 139 forks source link

Streaming #11

Closed audvin closed 1 year ago

audvin commented 1 year ago

Would love to see streaming support here, is that something that is on the roadmap shortly or far out?

https://blog.langchain.dev/streaming-support-in-langchain/

dissorial commented 1 year ago

Yes, it's on the roadmap -- in fact, as one of the next few features.

audvin commented 1 year ago

That's exciting to hear!

dissorial commented 1 year ago

I've looked into this but it seems like Conversational Retrieval QA Chain does not support streaming as of now. LangChain of course does support streaming responses in general, but to integrate it into this app, I'd have to rework the entire setup of the llm model and its chain. Streaming is great and I'd definitely love to have it as a feature, but given the above, it will probably take some time before I get to it.