fix so inference can be run against quantized models without adapters - Githubissues

axolotl-ai-cloud / axolotl

Go ahead and axolotl questions

https://axolotl-ai-cloud.github.io/axolotl/

Apache License 2.0

7.85k stars 864 forks source link

fix so inference can be run against quantized models without adapters #1834

Open winglian opened 2 months ago