search

abdeladim-s / pywhispercpp

Python bindings for whisper.cpp
https://abdeladim-s.github.io/pywhispercpp/
MIT License
180 stars 26 forks source link

Unable to load `quantized` models #33

Closed kishorekaruppusamy closed 9 months ago

kishorekaruppusamy commented 9 months ago

I am trying to load whisper tiny quantized version ( ggml-tiny-q5_1.bin) i trying this using jupyter kernal in visual studio code But when i try to run model = Model('./models/quantized/ggml-tiny-q5_1.bin', print_progress=False) Kernal is dying ( unable to load quantized model ) remaining unquantized models are working file seems to be issue in quantized version

image

Kindly need someone help !!!

abdeladim-s commented 9 months ago

@kishorekaruppusamy, I just pushed a new version 1.2.0 to PYPI that supports the latest version of whisper.cpp. Quantized models should be working now.

Let me know if you still have any issues ?

kishorekaruppusamy commented 9 months ago

@kishorekaruppusamy, I just pushed a new version 1.2.0 to PYPI that supports the latest version of whisper.cpp. Quantized models should be working now.

Let me know if you still have any issues ?

lets check ...

kishorekaruppusamy commented 9 months ago

@kishorekaruppusamy, I just pushed a new version 1.2.0 to PYPI that supports the latest version of whisper.cpp. Quantized models should be working now. Let me know if you still have any issues ?

lets check ...

Thanks for the changes !!!, it working now 💥