-
### Feature description
There are several requests for WASM (webworkers,...). Please add WASM32-WASI with NN WIT support
### Feature motivation
Solutions like WASMEdge allow for LLM inference…
-
### Summary
Enable support for manylinux2014 aarch64 systems in the WASI-NN PyTorch plugin
### Details
Currently, the WASI-NN PyTorch plugin only supports manylinux2014 x86_64 systems. I'd like to …
-
### Test Case
@alexcrichton pointed out that the WinML backend of wasi-nn managed to segfault on CI:
- [conversation](https://github.com/bytecodealliance/wasmtime/pull/9503#issuecomment-2433683294…
-
I'm expecting WASI-NN based examples for Zephyr Platform to run small NN models in controller environment using WAMR.
Can I get any solution on this?
-
When attempting to load this specific model, the following error logs can be seen. This is currently breaking the app (not hard crash but the app becomes unresponsive).
```
[2024-07-19T20:41:16Z I…
-
request `curl -X POST http://172.25.96.1:8080/v1/files -F "file=@paris_chunks.txt"` error, but request `curl -X POST http://172.25.96.1:8080/v1/embeddings` is ok.
Request `/v1/create/rag` is the sa…
-
### Summary
When the user input is too long, the API server will crash now. See the error messages below.
```
[2024-10-24 06:34:50.974] [info] [WASI-NN] GGML backend: the prompt is too long. Yo…
-
### Summary
Enable CANN support for WASI-NN ggml plugin.
### Details
Adding CANN support to the WASI-NN ggml plugin is relatively straightforward. The main changes involve adding the following code…
-
Do you guys plan on adding support for [wasi-nn](https://github.com/WebAssembly/wasi-nn)?
-
### Summary
WasmEdge plugins are a set of extensions that empower the wasm ecosystem, including the following proposals and specific experimental features:
- wasi_crypto
- wasi_http
- wasi_nn
-…
hydai updated
1 month ago