Running Whisper from GPU

DanRuta / xva-trainer

UI app for training TTS/VC machine learning models for xVASynth, with several audio pre-processing tools, and dataset creation/management.

92 stars 17 forks source link

Running Whisper from GPU #11

Open Mixomo opened 11 months ago

Mixomo commented 11 months ago

Hello! Is it possible to run Whisper from GPU? When transcribing the audios, I see that it uses my CPU and takes forever. I haven't seen the option to switch Whisper from CPU to GPU. I have a RTX 3060 Ti with CUDA installed. Thank you.