Error while running make chat.

mit-han-lab / TinyChatEngine

TinyChatEngine: On-Device LLM Inference Library

https://mit-han-lab.github.io/TinyChatEngine/

MIT License

751 stars 73 forks source link

Error while running make chat. #83

Open s-swathib opened 11 months ago

s-swathib commented 11 months ago

Hi @RaymondWang0 , I'm trying to implement this solution on windows(cpu) OS. And the pre-requisites have been met. Model used is LLaMA2_7B_chat_awq_int4 --QM QM_x86 We are getting the same error for CUDA model too. I'm getting error with 'make chat -j' as cuda is not available. Below I've attached the screenshot of error. Please provide the solution for this error. Thanks, Swathi S error_vm_make_1

Littledragon-wxl commented 7 months ago

Hello, I have encountered the same problem as you. Have you finally resolved it?