szilard / GBM-perf

Performance of various open source GBM implementations
MIT License
215 stars 28 forks source link

results on instances with smaller amount of cores m5.4xlarge (16 cores=8+8HT) #46

Closed szilard closed 3 years ago

szilard commented 3 years ago

Results on instances with smaller amount of cores - m5.4xlarge (16 cores=8+8HT):

On 4 cores:

0.1m:
xgboost 1 0.7338433
lightgbm 1.651 0.7174663
1m:
xgboost 7.46 0.7478858
lightgbm 5.267 0.7650181
10m:
xgboost 77.76 0.7539445
lightgbm 40.336 0.792273

On 8 cores:

0.1m:
xgboost 0.648 0.7338433
lightgbm 1.619 0.7174663
1m:
xgboost 4.465 0.7478858
lightgbm 3.669 0.7650181
10m:
xgboost 48.294 0.7539445
lightgbm 23.228 0.792273

On 16 cores (8+8HT):

0.1m:
xgboost 0.662 0.7338433
lightgbm 2.095 0.7174663
1m:
xgboost 3.955 0.7478858
lightgbm 4.019 0.7650181
10m:
xgboost 41.501 0.7539445
lightgbm 20.639 0.792273
szilard commented 3 years ago

Compare to r4.8xlarge from the main benchmark on 16 physical cores only (but older generation CPU):

0.1m:
xgboost 0.569 0.7338433
lightgbm 2.557 0.7174663
1m:
xgboost 3.412 0.7478858
lightgbm 4.18 0.7650181
10m:
xgboost 41.207 0.7539445
lightgbm 21.939 0.792273