Closed shaahji closed 1 week ago
This is to avoid hardcoding these paramters in config files for models that aren't (like phi3) yet officially supported by auto-gptq.
lintrunner -a
Make certain gptq options customizable via model specific mapping
This is to avoid hardcoding these paramters in config files for models that aren't (like phi3) yet officially supported by auto-gptq.
Checklist before requesting a review
lintrunner -a
(Optional) Issue link