search

bytecodealliance / wasi-nn

High-level bindings for wasi-nn system calls
Apache License 2.0
41 stars 33 forks source link

Bump version to v0.5.0 #87

Closed CaptainVincent closed 1 year ago

CaptainVincent commented 1 year ago
abrown commented 1 year ago

This looks good, but I would like a chance to clean up a couple things in the witx upstream before we do this bump. I'll do that early next week and then we can rebase this?

CaptainVincent commented 1 year ago

👌 Sure. I'll rebase my PR after the new witx release.

abrown commented 1 year ago

Ok, I did a bunch of clean up on the specification. Feel free to use that latest WITX to regenerate these bindings.

CaptainVincent commented 1 year ago

I'm done with the updates. Could you please help review to see if there are any modifications needed? Thank you.

CaptainVincent commented 11 months ago

WasmEdge has taken the lead in supporting this feature and incorporated it into our examples. And we almost completed its integration into our ggml (llm) backend implementation, and it will be released alongside the documentation, coming soon 🎉.

This is our complete example on how to use wasinn load_by_name to launch a GGML model. https://github.com/second-state/WasmEdge-WASINN-examples/tree/master/wasmedge-ggml-llama