search

McCloudS / subgen

Autogenerate subtitles using OpenAI Whisper Model via Jellyfin, Plex, Emby, Tautulli, or Bazarr
MIT License
532 stars 48 forks source link

[FEATURE] GPU Support? #10

Closed invisible-walrus closed 10 months ago

invisible-walrus commented 1 year ago

any chance there will be a mode which enables utilizing the CUDA cores of an nvidia GPU?

2600box commented 1 year ago

Wanted to voice my desire for this too. I use whisper-timestamped to batch series, but being more integrated with plex would be great

Wh1t3Rose commented 1 year ago

Id also love this feature

McCloudS commented 10 months ago

Hey all,

I updated the dockerfile to potentially support this. I don't have GPU at the moment to test, but will soon. Take a look at some of the options and re-pull from dockerhub to try it out.

McCloudS commented 10 months ago

There is now a CUDA image that can be pulled from mccloud/subgen:cuda. Try mapping your nvidia GPU and trying it.

McCloudS commented 10 months ago

Surprisingly, GPU support worked immediately. I pulled the GPU image and my Tesla T4 did a 21 minute file in about 4.5 minutes.

Closed!