search

t41372 / Open-LLM-VTuber

Talk to any LLM with hands-free voice interaction, voice interruption, Live2D taking face, and long-term memory running locally across platforms
MIT License
601 stars 69 forks source link

Any plans for adding interruptions to the TTS? #12

Closed lout33 closed 1 month ago

lout33 commented 2 months ago

I want to be able to interrupt the answers, should i try to implement it or its a WIP?

t41372 commented 2 months ago

It's almost done, but a few bugs remain, and I'm on vacation right now. I plan to finish and merge the changes by the end of the week.

lout33 commented 2 months ago

Awesome

Strider-Alex commented 2 months ago

Awesome! Looking forward to this! Hopefully interruption works with local audio play too (not browser)

t41372 commented 2 months ago

Interruption of local audio play without a browser would need a bit more time because I might have to find a way to ensure the microphone doesn't capture the audio from the speaker (because the mic would have to be always on for voice interruption). It's quite straightforward with the browser, but I might have to do the echo cancellation myself for non-browser voice interruption.

t41372 commented 1 month ago

Interruption, which includes hands-free voice interruption with the browser and manual interruption (type "i" at any time to interrupt) in the no-browser mode, is now complete and merged into the main branch. There are still some improvements to be made to the no-browser interruption, but it's basically done.

Also, the new version with interruption has many changes. To run with Live2D and the browser, you only need to launch server.py and open the web page in the browser now. Running server.py assumes Live2D mode with the browser, and running main.py assumes no Live2D mode without the browser. In addition, options mic-in-browser and live2d in the configurations no longer have any effects and have been deprecated.

Apparently this feature takes quite a bit longer than I expected, mainly because I was on vacation and was way busier than expected after the vacation. Sorry for the delay.