mit-han-lab / TinyChatEngine

TinyChatEngine: On-Device LLM Inference Library
https://mit-han-lab.github.io/TinyChatEngine/
MIT License
634 stars 59 forks source link

Support windows as experimental feature #54

Closed meenchen closed 9 months ago

meenchen commented 10 months ago

Initiate the support of Nvidia GPU on Windows. More tests are still needed.