coreweave / tensorizer

Module, Model, and Tensor Serialization/Deserialization
MIT License
153 stars 24 forks source link

[3.0] Avoid duplicate clone task in encryption where possible #145

Open bchess opened 2 weeks ago

bchess commented 2 weeks ago

Eta0 last week Adding a clone task can be skipped if a tensor is being cloned for not having been contiguous. Since that happens asynchronously, it should still be included up to this point (so its cloning status is tracked by clone_dependencies); it just won't need the final cloning part here.