Int4 LLaMA runtime and reference matmul - Githubissues

mit-han-lab / TinyChatEngine

TinyChatEngine: On-Device LLM Inference Library

https://mit-han-lab.github.io/TinyChatEngine/

MIT License

647 stars 62 forks source link

Int4 LLaMA runtime and reference matmul #4

Closed meenchen closed 1 year ago