`reshape` and `squeeze` implementations on `Ortex.Backend`

elixir-nx / ortex

ONNX Runtime bindings for Elixir

MIT License

134 stars 16 forks source link

`reshape` and `squeeze` implementations on `Ortex.Backend` #12

Closed mortont closed 1 year ago

mortont commented 1 year ago

Adding these helps reduce backend transfers when using Nx.Serving on autoregressive models and fixes some errors when using Ortex.Serving from multiple processes at once. Partially addresses https://github.com/elixir-nx/ortex/issues/11