VowpalWabbit / py-vowpal-wabbit-next

Experimental new Python bindings for the VowpalWabbit library
https://vowpal-wabbit-next.readthedocs.io/en/latest/
BSD 3-Clause "New" or "Revised" License
12 stars 5 forks source link

perf: reserve vector up front with size estimate when serializing model #85

Closed jackgerrits closed 1 year ago

jackgerrits commented 1 year ago

After implementing this change a 190MB model when from taking 63.26s to 9.11s to serialize.

Additionally, https://github.com/VowpalWabbit/vowpal_wabbit/pull/4613 also drastically improves the situation.

84