search

1neReality / MITSUHA

World's First Multilingual Inexpensive Therapeutic Sophisticated Ultra-responsive Holographic Agent. In simple terms, an AI you can talk to and it'll talk back with a body using VTube Studio.
https://www.youtube.com/@0neReality
GNU General Public License v3.0
214 stars 20 forks source link

Additional Feature Request: Multi-GPU Support with local Whisper STT Model #10

Open VuBrian22 opened 1 year ago

VuBrian22 commented 1 year ago

Running the whisper stt model, locally, would negate the first step in using OpenAI's API. Although this specific model (whisper-largev2) will be computationally expensive so multi-gpu support would help alleviate the issue.

DogeLord081 commented 1 year ago

Actually im experimenting with whisper x right now bcause my experience with whisper.cpp isnt great. It might have multi gpu support, ill check. If it doesnt though, it should be fine because i heard its incredibly fast