-
Once component model `resource`s are fully implemented, this specification should switch to using them for graphs, execution contexts, and possibly tensors (see https://github.com/WebAssembly/wasi-nn/…
-
In the current implementation, the order of nn_preload models should occur after loading wasi_nn plugin and before triggering the registration of wasi_nn plugin (At the very least, under the auto-dete…
-
A module instance is inserted into an internal wasi-nn hashmap when wasm runtime gets wasi-nn context, but is not removed when destroying wasi-nn context, which may cause memory leak and get a stale i…
-
### Summary
多次客户端访问使用不同提示词，结果却是一样的。参考如下输出：
% curl -X POST http://0.0.0.0:8080/v1/chat/completions \
-H 'accept:application/json' \
-H 'Content-Type: application/json' \
-d '{"messages":[{"r…
gaord updated
10 months ago
-
Enviroment: macOS, mac studio 32gb
Command:
```
LLAMA_LOG=1 wasmedge --dir .:. --nn-preload default:GGML:CPU:llama-2-7b-chat.Q5_K_M.gguf wasmedge-ggml-llama-interactive.wasm default
```
Then I go…
-
Got some error for `wasmedge version 0.13.5`
```
wasmedge --dir .:. \
--nn-preload default:GGML:AUTO:llama-2-7b-chat.Q5_K_M.gguf \
wasmedge-ggml-llama-interactive.wasm default
```
### Ou…
-
I've spinned up an EC2 instance from AWS to check the performance.
Config:
CPU: Amazon Linux 2023 AMI 2023.2.20231018.2 arm64 HVM kernel-6.1
GPU: c6g.xlarge 8GB 4 vCPU
Installed all the neces…
-
## Motivation
This issue records WASI Preview 2 and our implementation status, serve as a superior tracker.
## Details
- [ ] [wasi-clocks](https://github.com/WebAssembly/wasi-clocks) #2766
…
-
## Motivation
Ref: https://github.com/second-state/WasmEdge-WASINN-examples/issues/31
In the 0.13.4 release, we provided the WASI-NN ggml plugin for Linux (x86_64 and arm64). People would like t…
-
## Motivation
A new feature is being added to the WASI NN spec. We should support it.
## Details
see here: https://github.com/WebAssembly/wasi-nn/issues/36