-
This took me a while to figure out, so I thought I'd write some notes in case any of it may be useful.
I wanted to bundle some plugins/themes in `wp.data`, for several reasons: to cache the whole b…
-
### Summary
I tried using `--log-stat` to get the TPS when I running a model. It used to work. But now it didn't provide TPS information.
I also tried to use `run-llm.sh` and enabled the log infor…
-
Hi, I was wondering if any suggestions could be given with regards to implementing transformer architectures.
As far as I can tell, the wasi_nn proposal seems to have originally been just intended f…
-
Hi, I'm trying to support TensorFlow backend for Wasi-NN, but encountered several problems. To specify, the C API's version is [`2.6.0`](https://github.com/tensorflow/tensorflow/blob/v2.6.0/tensorflow…
-
## Motivation
This is a rough idea. Please discuss the details before we implement it.
WasmEdge uses plugins to handle the WASI-NN component. However, if users don't install the wasi-nn plugins …
-
## Motivation
For the WasmEdge 0.10.1-alpha.1 and after version, we supported the `WASI-NN` with OpenVINO plugin:
[WasmEdge-plugin-wasi_nn-openvino-0.10.1-alpha.1-ubuntu20.04_x86_64.tar.gz](https:…
-
Sorry for possibly trivial Q, but I can't find any example or guide.
Is it possible to use WASI from Python code and provide some Wasm custom imports during VM initialization/running? Namely, can I…
-
https://wasmer.io/wasmer-vs-wasmtime lists a couple of claims about why wasmer is better than wasmtime. The "Flexible compiler support" and "Favorite language integration" claims are easy to verify as…
-
## Motivation
I have converted a TensorFlow Lite model containing [select_tf_ops](https://www.tensorflow.org/lite/guide/ops_select) and am attempting to run inference on this model using Wasmedge.
…
-
Always get an answer
```
[INST] Hello! How can I help you today?
```
for [OpenHermes-2.5-Mistral-7B-GPTQ](https://huggingface.co/TheBloke/OpenHermes-2.5-Mistral-7B-GPTQ) first question.
``…