search

cloudpipe / cloudpickle

Extended pickling support for Python objects
Other
1.66k stars 167 forks source link

[RFC] a benchmark suite for cloudpickle. #292

Open pierreglaser opened 5 years ago

pierreglaser commented 5 years ago

FYI, I created a benchmark suite for cloudpickle here: cloudpickle_benchmarks.

This should make us gain visibility when working on performance improvements. I'm thinking we could run a benchmark comparison with master for each PR if a commit message contains a special pattern such as ci run-benchmarks.

Also, we can include this benchmark repository to @tomaugspurger's machine, that continuously runs benchmark for many PyData projects such as pandas, scikit-learn, joblib and so on.

ogrisel commented 5 years ago

Looks good. How long do they take to run in total?

pierreglaser commented 5 years ago

With the current settings, around 1 minute per commit per python version.