mit-han-lab / TinyChatEngine

TinyChatEngine: On-Device LLM Inference Library
https://mit-han-lab.github.io/TinyChatEngine/
MIT License
756 stars 73 forks source link

Porting TinyChatEngine to New Platform #119

Open soccercheng opened 3 weeks ago

soccercheng commented 3 weeks ago

I would like to port TinyChatEngine to new platform, say Risc-V 64, and I'm starting from "QM_REF".

BUT, I am not sure if downloading (and converting) correct models, from model zoo, for "QM_REF" is required ??? Is there corresponding models fore "QM_REF" implementation ?