Support for quantized models.

Const-me / Whisper

High-performance GPGPU inference of OpenAI's Whisper automatic speech recognition (ASR) model

Mozilla Public License 2.0

7.67k stars 665 forks source link

Support for quantized models. #134

Open FerLuisxd opened 12 months ago

FerLuisxd commented 12 months ago

I tried running the CLI with a quantized model using the whisper.cpp guide and it always returns nothing? https://github.com/ggerganov/whisper.cpp#quantization Does it support quantizated model at all? Tried it with the large model.

FerLuisxd commented 12 months ago

I believe even the official ones don't work as well? https://ggml.ggerganov.com/ I download them from here too