search

stanfordmlgroup / ngboost

Natural Gradient Boosting for Probabilistic Prediction
Apache License 2.0
1.62k stars 214 forks source link

Use XGBoost as base estimator #354

Open fif911 opened 2 months ago

fif911 commented 2 months ago

First of all thanks for such a great library and your continuous support. I am working on predictions with uncertainty using the NGBoost Regressor and want to improve the accuracy of predictions. My assumption is in the base estimator is better the whole algorithm may perform better.

Do you think it's possible to use a more advanced algorithm than the DecisionTreeRegressor e.g. XGBoost or even NN?

Best regards

manningkyle304 commented 2 months ago

See xgboost distribution! I have found that ngboost tended outperform it slightly, but maybe you can find better results. it's also up to 10x faster