search

undreamai / LLMUnity

Create characters in Unity with LLMs!
https://undream.ai
MIT License
684 stars 71 forks source link

Increase AI answer speed ? #269

Closed al3dv2 closed 4 days ago

al3dv2 commented 1 week ago

Describe the feature

Hi, I’d like to know how to have the AI's text display fully and as quickly as possible when it responds, because I’m using text-to-speech, and the pronunciation is slowed down by the typing speed. What should I change to display the entire text quickly? Thanks

amakropoulos commented 1 week ago

To show the full reply only when generated you can disable the stream parameter of the LLMCharacter.

It will not speed up the reply though, when stream is enabled it just shows the incomplete response while it is being generated. Disabling it will only show it when complete.