search

fedirz / faster-whisper-server

https://hub.docker.com/r/fedirz/faster-whisper-server
MIT License
477 stars 78 forks source link

MacOS GPU Support? #13

Closed austinm1120 closed 3 weeks ago

austinm1120 commented 4 months ago

Just curious if this currently has GPU support for MacOS or if its planned down the road?

This project looks awesome and super useful!

Thank you!

fedirz commented 4 months ago

Thanks for creating the issue, I asked my brother, who has a MacBook, to look into this

micseydel commented 3 weeks ago

@fedirz from my research, it may not be possible. I'm curious if you have any private notes on attempts at this.

fedirz commented 3 weeks ago

@micseydel I think it might be possible, but that will require you to build ctranslate2 yourself. Take a look at this issue https://github.com/OpenNMT/CTranslate2/issues/1562.