search

WebAssembly / wasi-nn

Neural Network proposal for WASI
471 stars 36 forks source link

Manage memory residency of tensors #69

Open geekbeast opened 8 months ago

geekbeast commented 8 months ago

Support multi-device memory residency of tensors.

abrown commented 3 months ago

Like we discussed (and as commented in #70), this change is probably not desirable if we adopt https://github.com/WebAssembly/wasi-nn/pull/74: if a user can't change where a model resides any more, they shouldn't be allowed to change where a tensor resides.