add HQQ support - Githubissues

xhedit / quantkit

cli tool to quantize gguf, gptq, awq, hqq and exl2 models

MIT License

60 stars 4 forks source link

Closed pabl-o-ce closed 5 months ago

pabl-o-ce commented 6 months ago

Love the repo ❤️

I want to create a good first issue if is possible to add HQQ quants

I was learning HQQ but I'm learning curve also

xhedit commented 6 months ago

Okay, I pushed an updated version to pypi with HQQ support. Update with pip install llm-quantkit -U and give it a whirl.

pabl-o-ce commented 6 months ago

Thanks @xhedit, very cool I would test it