run-llama / create-llama

The easiest way to get started with LlamaIndex
MIT License
735 stars 88 forks source link

Messages start to lag #161

Closed Laktus closed 3 weeks ago

Laktus commented 1 month ago

Hey,

After a few user and assistant messages the responses become very lagging when printing. The stream is not printing fluently anymore. Why does this happen? And is there anything that can be done against it? Thanks for any help.

marcusschiesser commented 1 month ago

What's your setup?