search

wAIfu-DEV / w-AI-fu_v2

Best way to create your own AI Vtuber/Streamer ! (Openai or NovelAI)
https://www.youtube.com/@Hilda-AI-VTuber
GNU General Public License v3.0
88 stars 7 forks source link

REQUEST: Elevenlabs TTS integration would be amazing + whisper #64

Open asdgggg opened 3 months ago

asdgggg commented 3 months ago

Is it realistic that we could get whisper/faster_whisper integrated for STT? I am not sure what STT it's using now, it says openai, whisper is from openai too so maybe it's already there, but I didnt get it to work.

And Elevenlabs as TTS for the waifu? Imo Elevenlabs is much better and can do more languages, although it's more expensive. There is a eleven_turbo_v2 model that's pretty fast and it can do streaming (generates the responses in chunks so it's faaast).

I saw in Projects that 11 is planned already, any idea when it could be integrated? I am sorry if I sound impatient!

Anyway, I am blown away by the wAIfu so far!

xxandeer commented 3 months ago

SST === Speach To Text, did you route your mic correct?

On Thu, Mar 14, 2024 at 5:50 PM asdgggg @.***> wrote:

Is it realistic that we could get whisper/faster_whisper integrated for STT? I am not sure what STT it's using now, it says openai, whisper is from openai too so maybe it's already there, but I didnt get it to work.

And Elevenlabs as TTS for the waifu? Imo Elevenlabs is much better and can do more languages, although it's more expensive. There is a eleven_turbo_v2 model that's pretty fast and it can do streaming (generates the responses in chunks so it's faaast).

I saw in Projects that 11 is planned already, any idea when it could be integrated? I am sorry if I sound impatient!

Anyway, I am blown away by the wAIfu so far!

— Reply to this email directly, view it on GitHub https://github.com/wAIfu-DEV/w-AI-fu_v2/issues/64, or unsubscribe https://github.com/notifications/unsubscribe-auth/AJQTEIAEHW4GF7CD6XM372TYYHILVAVCNFSM6AAAAABEWPHIDKVHI2DSMVQWIX3LMV43ASLTON2WKOZSGE4DMOBSHA3TKOA . You are receiving this because you are subscribed to this thread.Message ID: @.***>

asdgggg commented 3 months ago

If you mean Voice Input Device then yes, I set it to my webcam which I just used for a call. In the console it says this though when I click the play button: Cannot use selected audio device as output audio device.

I think it should say input audio device right? Or is it just the same function as for testing output devices and it shouldn't be there?

When I do right ctrl:

Recording... Finished recording.

But nothing happens.