search

xhedit / quantkit

cli tool to quantize gguf, gptq, awq, hqq and exl2 models
MIT License
61 stars 4 forks source link

Marlin support #6

Open blap opened 1 month ago

blap commented 1 month ago

Please, add Marlin support: https://github.com/ist-daslab/sparse-marlin https://github.com/ist-daslab/marlin