search

aplisay / llm-agent

LLM based Agent
MIT License
17 stars 2 forks source link

STT latency and conversation break improvements #18

Open rjp44 opened 8 months ago

rjp44 commented 8 months ago

Two things, one issue:

  1. Improve STT larency
  2. Figure out a more flexible way of doing conversation break detection, where we get text from the STT and send it to the LLM, allow us to re-send if the user continues speaking. Probably best achieved by writing a custom STT layer.
rjp44 commented 4 weeks ago

Significant improvements in 62ea296a4893972b16bf557d5a6d586394fc604e but leaving open as there is probably more that can be done.