search

emirsahin1 / llm-axe

A simple, intuitive toolkit for quickly implementing LLM powered applications.
MIT License
66 stars 14 forks source link

Add text streaming for responce #3

Closed aritralegndery closed 1 month ago

emirsahin1 commented 1 month ago

Thanks for the suggestion. It will be added soon. However, one downside to streaming is that the agents won't be able to keep track of their history when streaming is turned on. The user will be responsible for storing chat history, which isn't a big deal but something to be aware of.

aritralegndery commented 1 month ago

Thanks