search

GuernikaCore / GuernikaModelConverter

GNU General Public License v3.0
19 stars 6 forks source link

Compression fails #5

Open jb-apps opened 7 months ago

jb-apps commented 7 months ago

Hello, amazing work with Guernika, I love using it.

I have a Macbook Air M1 with 8GB of RAM and to run Guernika with XL models I need to compress them. Unfortunately, the conversion fails. After further research it seems that Guernika Model Converter needs to be updated. See this fix Fix quantize-nbits flag.

Currently using version 7.4.1 (1)

Would you provide a new update soon?

Thanks

Screenshot 2024-03-07 at 10 17 15
jb-apps commented 7 months ago

Hello @GuiyeC could you at least submit the latest code so I can submit a PR that fixes the issue? Cheers