search

Mozilla-Ocho / llamafile

Distribute and run LLMs with a single file.
https://llamafile.ai
Other
16.75k stars 830 forks source link

fail to load Qwen1.5-MoE-A2.7B-Chat on win10 #424

Open Rinoahu opened 1 month ago

Rinoahu commented 1 month ago

Dear llamafile teams,

llamafile(v0.8.4 ) failed to load Qwen1.5-MoE-A2.7B-Chat gguf model on windows 10, however, it works on Linux system. The errors are shown below: Capture

Could you please fix this issue? Thanks!