This PR adds support to run a background task with the LLM chain output. This is useful for any after-response operations such as updating a database, running additional code conditioned on chain output, etc.
Changelog
⚡ updated LangchainStreamingResponse to convert background attribute into a partial if chain.arun is successful
Description
This PR adds support to run a background task with the LLM chain output. This is useful for any after-response operations such as updating a database, running additional code conditioned on chain output, etc.
Changelog
LangchainStreamingResponse
to convertbackground
attribute into a partial ifchain.arun
is successful