statsmodels / statsmodels

Statsmodels: statistical modeling and econometrics in Python
http://www.statsmodels.org/devel/
BSD 3-Clause "New" or "Revised" License
10.15k stars 2.89k forks source link

SUMM/ENH: LR type tests #3446

Open josef-pkt opened 7 years ago

josef-pkt commented 7 years ago

compare_lr, compare_jtest, ANOVA and related e.g. anova type tests base on deviance or pearson chisquare for GLM

I don't see a summary issue, but many individual issues

general discussion on missing features in GLM, especially also related to scale handling

related profile likelihood

josef-pkt commented 7 years ago

an extra issue one-sided LR-test with a single hypothesis (e.g. a dispersion parameter) signed square root LR test example mentioned in Yang, Zhao, James W. Hardin, and Cheryl L. Addy. 2009. “A Score Test for Overdispersion in Poisson Regression Based on the Generalized Poisson-2 Model.” Journal of Statistical Planning and Inference 139 (4): 1514–21. doi:10.1016/j.jspi.2008.08.018. dispersion test Poisson versus GP-2 (generalized Poisson PR #3727 GP-P allows over and under dispersion, so Poisson is in the interior of the parameter space of GP-P (related one-sided at the boundary should be the same as one-sided signed LR-test for a single parameter that can be at the boundary, IIRC) in terms of application: score test in the Poisson versus GP2 case is more powerful and less conservative than Wald and LR in examples of Yang, Hardin and Addy. (They only check alpha=0.05, score_test doesn't look conservative in a quick MC at alpha=0.01 or alpha=0.001)

josef-pkt commented 5 years ago

an special case for random effects, GAM, penalized splines Wood, Simon N. 2013. “A Simple Test for Random Effects in Regression Models.” Biometrika 100 (4): 1005–10. https://doi.org/10.1093/biomet/ast038. ends up with the distribution of a weighted sum of chisquare random variables.

3363, #1289