Sharrnah / whispering-ui

Native UI for the Whispering Tiger project - https://github.com/Sharrnah/whispering (live transcription / translation)
https://whispering-tiger.github.io/
MIT License
218 stars 12 forks source link

Support for AMD GPUs? #11

Closed kulocora closed 2 months ago

kulocora commented 1 year ago

Thanks for making Whispering Tiger! It's been super helpful for me.

I was using it on my Radeon GPU and couldn't help but think - it would be amazing if Whispering Tiger could incorporate vendor-agnostic whisper ports like https://github.com/Const-me/Whisper so that AMD GPU users could benefit from GPU acceleration too!

Anyways, thanks a lot for all the work!

Sharrnah commented 2 months ago

Hi.

Finally the Update i released today can Support AMD GPU's using Direct-ML.

It is not (yet) available for Faster Whisper, but it works with Transformer Whisper or Original Whisper and most other integrated AI model implementations.

grafik Screenshot 2024-07-20 231549_2

So i will close this now. Feel free to open a new issue if you find anything. :)