WebAssembly / wasi-nn

Neural Network proposal for WASI
470 stars 36 forks source link

Residence proposal #70

Open abrown opened 6 months ago

abrown commented 6 months ago

This merges together some of #69 with various discussions we've had in the ML working group.

abrown commented 3 months ago

This change is probably not desirable if we adopt #74: if a user can't change where a model resides any more, they shouldn't be allowed to change where a tensor resides.

geekbeast commented 1 month ago

Is this also implying that tensors in pipelines that cross hardware boundaries will automatically be moved around at compute time?