coreweave / tensorizer

Module, Model, and Tensor Serialization/Deserialization
MIT License
153 stars 24 forks source link

Release 2.9.0? #116

Closed mikeoconnor0308 closed 3 months ago

mikeoconnor0308 commented 3 months ago

Thanks for the library, it's great!

The addition of n_readers #87 massively improves the performance, and the README.md refers to the setting. Is there a plan to release 2.9.0 with this feature?

wbrown commented 3 months ago

We do plan on releasing it, as soon as we address the performance regressions for the n_readers==1 case, as there are some HTTP proxy servers that do not properly work with range gets.

Eta0 commented 3 months ago

Tensorizer v2.9.0 is fully released (git tag, PyPI page) as of 2024-04-17!