AniZpZ / AutoSmoothQuant

An easy-to-use package for implementing SmoothQuant for LLMs
MIT License
82 stars 7 forks source link

Support Mixtral and Baichuan 7B #7

Closed AniZpZ closed 9 months ago