Create HLO token in the computation only when needed

elixir-nx / nx

Multi-dimensional arrays (tensors) and numerical definitions for Elixir

2.66k stars 194 forks source link

Create HLO token in the computation only when needed #1494

Closed jonatanklosko closed 6 months ago

jonatanklosko commented 6 months ago

We now check if the token will be needed, and only create if so. In places that pass the token through (optional computation, while, ...), we now do so conditionally.