💬 Add BitsAndBytesConfig Optimization Method

Vaibhavs10 / insanely-fast-whisper

Apache License 2.0

7.79k stars 547 forks source link

Closed kadirnar closed 4 months ago

kadirnar commented 6 months ago

I will test it on my Linux device tomorrow and share the speed results.

flexchar commented 5 months ago

I totally understand how difficult it must be to catch tomorrow! It always seems to be so close yet never today!! ;)

Anyhow, I would love to see the results. @kadirnar

kadirnar commented 4 months ago

I want to add this and more optimizations. What are you thinking? @Vaibhavs10