kadirnar / whisper-plus

WhisperPlus: Faster, Smarter, and More Capable 🚀
Apache License 2.0
1.73k stars 137 forks source link

Add Hqq + Compile + Flash Attention support #98

Open kadirnar opened 6 months ago

kadirnar commented 6 months ago

I added hqq + compile support to WhisperPlus library but it doesn't work. Torch.compile doesn't support Whisper model. Transformers library will work when torch.compile support is added.

https://github.com/huggingface/transformers/issues/30707