search

jitsi / skynet

AI core services for Jitsi
Apache License 2.0
30 stars 7 forks source link

Suggestion: Use “Insanely Fast Whisper” for Enhanced Transcription Speed #113

Open tuhinmallick opened 2 weeks ago

tuhinmallick commented 2 weeks ago

I noticed that the current integration uses Faster Whisper for transcription. I would like to suggest replacing it with “Insanely Fast Whisper” for improved performance, especially in GPU-based environments. This version utilizes optimizations like Flash Attention 2, potentially leading to faster transcription times. Could this replacement be considered, or would it cause compatibility issues?

https://github.com/Vaibhavs10/insanely-fast-whisper

saghul commented 2 weeks ago

Interesting! Thanks for sharing! 🙏

saghul commented 2 weeks ago

@rpurdel 👀