search

LlamaEdge / rag-api-server

A RAG API server written in Rust following OpenAI specs
https://llamaedge.com/docs/user-guide/server-side-rag/quick-start
Apache License 2.0
21 stars 7 forks source link

failed to run the api server #13

Open chengchengpei opened 3 months ago

chengchengpei commented 3 months ago

I followed the instructions in readme.md. it built successfully i guess. but when i run wasmedge rag-api-server.wasm -h, i got the following errors:

[2024-05-29 18:44:18.672] [error] instantiation failed: unknown import, Code: 0x62
[2024-05-29 18:44:18.672] [error]     When linking module: "rustls_client" , function name: "new_codec"
[2024-05-29 18:44:18.672] [error]     At AST node: import description
[2024-05-29 18:44:18.672] [error]     At AST node: import section
[2024-05-29 18:44:18.672] [error]     At AST node: module
ChloeWKY commented 3 months ago

Seems the rustls plugin is not required. Please try the following command to reinstall wasmedge with ggml + rustls plugins:

curl -sSf https://raw.githubusercontent.com/WasmEdge/WasmEdge/master/utils/install.sh | bash -s -- -v 0.13.5 --plugins wasi_nn-ggml wasmedge_rustls

Mentioned here #6

apepkuss commented 2 months ago

@chengchengpei The issue is still there on your side? Thanks!