lucianopaz / compress_pickle

Standard python pickle, thinly wrapped with standard compression libraries
MIT License
42 stars 12 forks source link

Add optional "pickletools.optimize" step to dump #16

Closed SamuelBradley closed 4 years ago

SamuelBradley commented 4 years ago

Add optional "pickletools.optimize" step to dump prior to the compression. https://docs.python.org/3/library/pickletools.html#pickletools.optimize

This should squeeze some additional load performance and size reduction for minimal effort.

lucianopaz commented 4 years ago

Ah, I didn't know about pickletools.optimize. Thanks @SamuelBradley, this should be easy to add in.