ajndkr / lanarky

The web framework for building LLM microservices
https://lanarky.ajndkr.com/
MIT License
970 stars 74 forks source link

fix(langchain): add support for LLMs without support for async callback handlers #166

Closed ajndkr closed 9 months ago

ajndkr commented 9 months ago

Description

Fixes #164.

This PR adds new functionality to langchain adapter's streaming response: run mode.

Setting the run mode to "async" or "sync" defines how the langchain object is executed (via .acall or __call__ respectively)

Changelog: