Plantoidz / mechanical-garden-FA

Multimodal mechanical plantoid garden repository.
3 stars 3 forks source link

Enable non-blocking LLM generation if next speaker isn't human #8

Open benrito opened 2 months ago

benrito commented 2 months ago

One way of speeding up the responsiveness of the program is to start generating the next LLM call while the current agent is speaking.

This could be tricky but let's investigate...

benrito commented 2 months ago

Could be related to #9