Closed script-money closed 3 months ago
tail start-llamaedge.log
[INFO] Qdrant score threshold: 0.5
[INFO] Chunk capacity (in tokens): 100
[INFO] Enable prompt log: true
[INFO] Enable plugin log: true
[INFO] Socket address: 0.0.0.0:8080
[INFO] RAG policy: system-message
[2024-06-03 18:48:03.977] [info] [WASI-NN] GGML backend: LLAMA_COMMIT 95fb0aef
[2024-06-03 18:48:03.977] [info] [WASI-NN] GGML backend: LLAMA_BUILD_NUMBER 2963
[2024-06-03 18:48:03.977] [error] [WASI-NN] GGML backend: Model file not found.
Error: Operation("Failed to initialize the core context. Failed to initialize computation context. Reason: Failed to create a chat graph. Backend Error: Unknown Wasi-NN Backend Error Code `103`")
re-run gaianet init
and re-download it works anyway
Yeah. It needs to download a very large file (the LLM is several GBs). Sometimes the network is not stable and the file could be corrupted.
The program stop with no error.
Apple M2 Pro 32 GB