Open juanmc2005 opened 1 year ago
Hello! First of all thank you for your work!
I wanted to report this problem that I'm having when trying to load quantized models. Could someone give me a hand to see if I'm doing something wrong?
Whisper.from_pretrained("ggml-model-whisper-small-q5_1.bin")
RuntimeError: src/whispercpp/context.cc#L69: c.wctx is not initialized
whisper_model_load: unknown tensor 'X����ب��G]���u��H.�*sKGi�����ڔ�����<�! L�Ϊ�����' in model file
The model should be loaded and it shouldn't crash
python: 3.10.12 OS: Ubuntu 22.04
same, want to see quantized models running
Describe the bug
Hello! First of all thank you for your work!
I wanted to report this problem that I'm having when trying to load quantized models. Could someone give me a hand to see if I'm doing something wrong?
To reproduce
Whisper.from_pretrained("ggml-model-whisper-small-q5_1.bin")
RuntimeError: src/whispercpp/context.cc#L69: c.wctx is not initialized
I also get the following log:Expected behavior
The model should be loaded and it shouldn't crash
Environment
python: 3.10.12 OS: Ubuntu 22.04