coreweave / tensorizer

Module, Model, and Tensor Serialization/Deserialization
MIT License
180 stars 25 forks source link

fix(examples): Generate non-persistent buffers on the intended device #96

Closed Eta0 closed 7 months ago

Eta0 commented 7 months ago

Non-persistent buffer devices, round 2

Do-over of #91. This uses a more efficient method to land non-persistent buffers on the correct device in examples/deserialize.py, initializing them there from the beginning rather than copying them. Copying had suboptimal efficiency, as noted here in #90.