search

Mobile-Artificial-Intelligence / maid

Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.
MIT License
1.03k stars 98 forks source link

Failed to load dynamic library 'maid.dll'. #574

Closed cjl84914 closed 2 weeks ago

cjl84914 commented 1 month ago

Good morning. I try maid-windows of LlamaCpp func. I have loaded a llama-2 model, log showed Failed to load dynamic library 'maid.dll'. R04HQS02VH$@9LYF81U4M6X

danemadsen commented 1 month ago

I cant reproduce your error on windows? Are you moving the exe away from where it was extract? What version are you using?

cjl84914 commented 1 month ago

I use this version: https://github.com/Mobile-Artificial-Intelligence/maid/releases/download/1.2.8/maid-windows.zip Operation steps:

  1. unzip
  2. double click maid.exe
  3. click load GUFF button select llama-2-7b-chat.Q2_K.gguf and Model Successful Loaded. model has download from: https://huggingface.co/monal04/llama-2-7b-chat.Q4_0.gguf-GGML/blob/main/llama-2-7b-chat.Q2_K.gguf
  4. return and send "hello" prompt, wait moment no response.
  5. log show: image

my OS is windows10 x64 22H2.

danemadsen commented 1 month ago

I use this version: https://github.com/Mobile-Artificial-Intelligence/maid/releases/download/1.2.8/maid-windows.zip Operation steps:

  1. unzip
  2. double click maid.exe
  3. click load GUFF button select llama-2-7b-chat.Q2_K.gguf and Model Successful Loaded. model has download from: https://huggingface.co/monal04/llama-2-7b-chat.Q4_0.gguf-GGML/blob/main/llama-2-7b-chat.Q2_K.gguf
  4. return and send "hello" prompt, wait moment no response.
  5. log show: image

my OS is windows10 x64 22H2.

Dam, OK is there any previous versions that do work for you?

cjl84914 commented 1 month ago

I tested 1.2.6 that same error.

danemadsen commented 2 weeks ago

@cjl84914 what was the issue?