search

rhasspy / wyoming-faster-whisper

Wyoming protocol server for faster whisper speech to text system
MIT License
82 stars 32 forks source link

Add selectable "Processor" to wrapper. #4

Open Tekgnome-svg opened 1 year ago

Tekgnome-svg commented 1 year ago

Describe the issue you are experiencing I'm unable to select my Nvidia Tesla as the default processor

What type of installation are you running? Home Assistant OS

Which operating system are you running on? unRAID with HAOS in a VM

Which add-on are you reporting an issue with? Faster Whisper

What is the version of the add-on? 1.0.0

Anything in the add-on logs that might be useful for us? This is my first ever issue report so I apologize for anything missing.

Wyoming Faster Whisper supports arguments for which device to use for processing and it supports CUDA cores. The addon wrapper omits this and there is no such option exposed in the configuration. This causes the underlying docker container to not get the instruction to use the GPU. This prevents me from leveraging my Nvidia GPU for acceleration.

synesthesiam commented 7 months ago

Can HA add-ons access the GPU?

carlos-sarmiento commented 3 months ago

As someone who uses this container outside the HA Add-On infrastructure (I run Home Assistant Docker), having these options to use the GPU if available would be amazing!