search

McCloudS / subgen

Autogenerate subtitles using OpenAI Whisper Model via Jellyfin, Plex, Emby, Tautulli, or Bazarr
MIT License
532 stars 48 forks source link

Evaluate use of Whisper-Jax for more Speed #20

Closed semigoro closed 10 months ago

semigoro commented 10 months ago

Hello,

i found your repo, awesome idea, was looking some time for something like this. this is a little suggestion. i came across this repo Whisper-Jax. The Dev says its fast, 70x faster than normal whisper on tpu. i know normally you have no tpu, but the benchmarks in the repo show also improvements on gpu. you can give it a shot on this hugginface space from the same dev.

Maybe you can look into it. Would be awesome if you can make it even faster as it is now. Thanks for your tool and the time you invest in it ;)

McCloudS commented 10 months ago

It appears whisper-jax is still missing feature necessary to do accurate subtitles via stable-ts or whisperX.

See: https://github.com/jianfch/stable-ts/issues/142