No integers for whisper quantize

natrys / whisper.el

Speech-to-Text interface for Emacs using OpenAI's whisper model and whisper.cpp as inference engine.

140 stars 10 forks source link

Closed jasoninja closed 4 months ago

jasoninja commented 4 months ago

Whisper-quantize is looking for an integer, but there aren’t any integers given in the documentation, just strings, q4_01, etc.

natrys commented 4 months ago

It shouldn't be looking for an integer, indeed the correct value is a string as noted in doc string. Not sure why it's not working for you.

Note that if you are actually trying q4_01 as you say, that's not a valid value. Instead try: q4_1. Basically:

(setq whisper-quantize "q4_1")

(it seems whisper.cpp added a bunch of q*_k options so I need to add those as well, but that shouldn't be relevant here)

jasoninja commented 4 months ago

When I do an apropos search for whisper-quantize, it has (custom-type (choice integer (const nil)) in its plist.

jasoninja commented 4 months ago

Which is in line 108 of whisper.el.

jasoninja commented 4 months ago

So if I just change integer to string, it should work?

natrys commented 4 months ago

Ooops you are right. Didn't think of that at all as I haven't used the customisation interface in a while. Sorry about that.

Either change integer to string in that line, or do a git pull. Thanks!