Quantco / slim-trees

Pickle your ML models more efficiently for deployment 🚀
MIT License
17 stars 1 forks source link

Add large sklearn benchmark #41

Closed pavelzw closed 1 year ago

github-actions[bot] commented 1 year ago
(benchmark 4537034165 / attempt 1) Base results / Our results / Change Model Size Dump Time Load Time
sklearn rf 20M 20.8 MiB / 3.0 MiB / 6.87 x 0.03 s / 0.04 s / 1.37 x 0.03 s / 0.03 s / 0.96 x
sklearn rf 20M lzma 6.5 MiB / 2.0 MiB / 3.25 x 11.57 s / 1.11 s / 0.10 x 0.56 s / 0.19 s / 0.33 x
sklearn rf 200M 212.3 MiB / 30.6 MiB / 6.94 x 0.22 s / 0.34 s / 1.53 x 0.27 s / 0.37 s / 1.34 x
sklearn rf 200M lzma 47.5 MiB / 14.6 MiB / 3.25 x 93.98 s / 17.47 s / 0.19 x 4.32 s / 1.45 s / 0.34 x
sklearn rf 1G 1157.5 MiB / 166.8 MiB / 6.94 x 1.30 s / 1.65 s / 1.27 x 1.51 s / 1.83 s / 1.21 x
sklearn rf 1G lzma 257.1 MiB / 98.1 MiB / 2.62 x 475.00 s / 101.80 s / 0.21 x 23.36 s / 8.74 s / 0.37 x
sklearn gb 2M 2.2 MiB / 1.1 MiB / 2.08 x 0.03 s / 0.24 s / 8.12 x 0.07 s / 0.16 s / 2.39 x
sklearn gb 2M lzma 0.6 MiB / 0.2 MiB / 3.82 x 0.91 s / 0.46 s / 0.50 x 0.09 s / 0.15 s / 1.65 x
lgbm gbdt 2M 2.6 MiB / 1.0 MiB / 2.78 x 0.09 s / 0.25 s / 2.78 x 0.01 s / 0.15 s / 12.14 x
lgbm gbdt 2M lzma 0.9 MiB / 0.5 MiB / 1.90 x 1.31 s / 0.51 s / 0.39 x 0.08 s / 0.22 s / 2.73 x
lgbm gbdt 5M 5.3 MiB / 1.9 MiB / 2.81 x 0.18 s / 0.51 s / 2.82 x 0.03 s / 0.32 s / 12.54 x
lgbm gbdt 5M lzma 1.7 MiB / 0.8 MiB / 1.96 x 3.12 s / 1.07 s / 0.34 x 0.15 s / 0.38 s / 2.55 x
lgbm gbdt 20M 22.7 MiB / 7.6 MiB / 3.00 x 0.72 s / 2.11 s / 2.95 x 0.11 s / 1.32 s / 11.83 x
lgbm gbdt 20M lzma 6.3 MiB / 3.0 MiB / 2.09 x 16.68 s / 4.86 s / 0.29 x 0.59 s / 1.54 s / 2.61 x
lgbm gbdt 100M 101.1 MiB / 33.0 MiB / 3.06 x 3.23 s / 9.39 s / 2.91 x 0.53 s / 116.98 s / 219.18 x
lgbm gbdt 100M lzma 25.6 MiB / 10.6 MiB / 2.41 x 83.14 s / 23.69 s / 0.28 x 2.44 s / 98.06 s / 40.16 x
lgbm rf 10M 10.9 MiB / 3.2 MiB / 3.46 x 0.36 s / 0.69 s / 1.92 x 0.04 s / 0.56 s / 12.54 x
lgbm rf 10M lzma 0.7 MiB / 0.4 MiB / 1.85 x 1.87 s / 0.95 s / 0.51 x 0.12 s / 0.58 s / 4.84 x