search

qwopqwop200 / GPTQ-for-LLaMa

4 bits quantization of LLaMA using GPTQ
Apache License 2.0
2.98k stars 457 forks source link

can it support openllama model? #273

Closed Ted8000 closed 1 year ago

Ted8000 commented 1 year ago

i use it for openllama, but th result generate seems not right.