Closed Shivanandroy closed 1 year ago
@willydouhard : I think, it doesn't work when the chain takes 2 steps for final answer, instead of one.
What if you remove cb.answer_reached = True
?
Yeah in this case you should remove cb.answer_reached = True
but you will need to provide the final answer tokens instead. All LangChain chains do not have a consistent final answer token delimiter though. In those cases final answer streaming is not possible.
I implemented a ConversationalRetrievalChain and streaming the final output to the UI seems to be problematic.
Am I missing something?
here's my code: