-
Currently, the TFLite wasi-nn implementation performs quantization if quantization scale and zero-point exist (https://github.com/bytecodealliance/wasm-micro-runtime/blob/main/core/iwasm/libraries/was…
CIPop updated
4 months ago
-
Is there async mode example for wasi-nn? I am unable to add wasi-nn plugin to wasmedge_sdk async WasiCtx.
-
I was running a wasmedge server with inference support cloned from [here](https://github.com/WasmEdge/wasmedge_hyper_demo/tree/main/server-tflite), but with newer dependencies and was facing an error …
-
The command to run the `serach-api-server.wasm` .
```
wasmedge --dir .:. --env LLAMA_LOG="info" \
--nn-preload default:GGML:AUTO:Meta-Llama-3.1-8B-Instruct-Q5_K_M.gguf \
search-api-server.…
-
#### Feature
Currently the ONNX backend in `wasmtime-wasi-nn` only uses the default CPU execution provider and ignores the `ExecutionTarget` requested by the WASM caller.
https://github.com/bytecod…
-
demo
-
This issue is intended for tracking adding a shim for wasi-nn.
Tasks:
- [ ] ...
- [ ] ...
-
### Request Description
Addition of `ov_core_add_extension` to C-api to enable extension loading.
I can submit a PR for this.
### Feature Use Case
I'd like to use this in [openvino-rs](https://git…
-
### Summary
## Motivation
WasmEdge supports PyTorch, TensorFlow Lite, llama.cpp, and more NN backend. Dealing with the text-to-voice is a big thing that we want to achieve. To make it possible, …
hydai updated
6 months ago
-
I am using a debian bookworm image. Installed openvino_2024.1.0.15008(using [archive](https://docs.openvino.ai/2024/get-started/install-openvino/install-openvino-archive-linux.html)). Installed wasmti…