Support opt fp32/int4 - Githubissues

mit-han-lab / TinyChatEngine

TinyChatEngine: On-Device LLM Inference Library

https://mit-han-lab.github.io/TinyChatEngine/

MIT License

756 stars 73 forks source link

Support opt fp32/int4 #33

Closed meenchen closed 1 year ago