Chainlit / cookbook

Chainlit's cookbook repo
https://github.com/Chainlit/chainlit
726 stars 270 forks source link

Enable streaming in Langchain #29

Closed krishvsoni closed 8 months ago

krishvsoni commented 11 months ago

Enable streaming in Langchain

Description:

This pull request enables streaming in Langchain by making the following changes:

These changes will allow the Langchain app to start sending the response to the user as soon as it is available, rather than waiting for the entire response to be returned from the LLM. This can improve the user experience, especially for chatbots and other applications where the user is expecting a response immediately.

willydouhard commented 11 months ago

I can't see the changes you mention in the description.