search

fedirz / faster-whisper-server

https://hub.docker.com/r/fedirz/faster-whisper-server
MIT License
373 stars 53 forks source link

Device index for multiple gpus #51

Closed Nyralei closed 2 weeks ago

Nyralei commented 1 month ago

Hello. I have a feature request: faster-whisper supports setting device_index in WhisperModel class. https://github.com/SYSTRAN/faster-whisper/blob/master/faster_whisper/transcribe.py#L607 Currently faster-whisper-server doesn't support it without modification of source code. Would be great to have an option to set other attributes too

fedirz commented 4 weeks ago

Will add support for this sometime this week.