search

OpenGVLab / OmniQuant

[ICLR2024 spotlight] OmniQuant is a simple and powerful quantization technique for LLMs.
MIT License
689 stars 53 forks source link

Which bug do you fix for auto_gptq #79

Open BaohaoLiao opened 4 months ago

BaohaoLiao commented 4 months ago

Hi, I want to use the newest version of auto_gptq. In this repos, you fix some bugs of the original auto_gptq. May I ask what you mainly fix?

ChenMnZ commented 4 months ago

Please refer https://github.com/ChenMnZ/AutoGPTQ-bugfix/commit/ad5b0d72eece9a3cf6d4b7a5c710a6cc0331de80 for details.