search

qwopqwop200 / GPTQ-for-LLaMa

4 bits quantization of LLaMA using GPTQ
Apache License 2.0
2.98k stars 457 forks source link

Support Mistral. #284

Open nbollman opened 11 months ago

nbollman commented 11 months ago

Mistral 7B is dominating the local LLM scene right now and your software doesn't load it. I need your software to work with it... Can we please make your software work with it?