mit-han-lab / TinyChatEngine

TinyChatEngine: On-Device LLM Inference Library
https://mit-han-lab.github.io/TinyChatEngine/
MIT License
647 stars 62 forks source link

Fix quantizer and update demo parameters and example for smoothed model. #9

Closed meenchen closed 1 year ago