Awq 4 bit quantization support - Githubissues

OpenNMT / OpenNMT-py

Open Source Neural Machine Translation and (Large) Language Models in PyTorch

https://opennmt.net/

MIT License

6.73k stars 2.25k forks source link

Awq 4 bit quantization support #2508

Closed vince62s closed 10 months ago