kaz-Anova / StackNet

StackNet is a computational, scalable and analytical Meta modelling framework
MIT License
1.32k stars 344 forks source link

How does your treatment of sparse data differ from full data? #29

Closed vinkaga closed 7 years ago

vinkaga commented 7 years ago

Thanks for this example, I just submitted - I am ranked 78 atm :-)

In your code, the sparse data is treated differently from dense/full data. How is that handled? Are you estimating the missing data before fit or the fit is simply ignoring the missing data?

kaz-Anova commented 7 years ago

Missing values are never ignored. However algorithms threat them differently.

In native StackNet algorithm ( not xgboost, lightgbm etc) missing values are handled as zeros.

xgboost, lightgbm and other algos may treat these differently .