xhedit / quantkit

cli tool to quantize gguf, gptq, awq, hqq and exl2 models
MIT License
59 stars 4 forks source link