moderndive / ModernDive_book

Statistical Inference via Data Science: A ModernDive into R and the Tidyverse
https://www.moderndive.com/
Other
759 stars 491 forks source link

Ch 11 Inference for Regression: Amplify what todo if any of LINE conditions aren't met #452

Closed rudeboybert closed 2 years ago

rudeboybert commented 2 years ago

Language I used:

If the conditions are grossly violated, you cannot put full faith into all p-values and confidence intervals, and thus results should be taken with a grain of salt and viewed as preliminary. Further model improvements must be made for so that conditions can be met

Language suggested by others

this is mostly what I tell them too. For more advanced students they notice that inclusion of an interaction/other specifications helps, but I mostly tell them we are identifying whether we can use these results, or if a more advanced approach is needed (which will be covered in future classes).

and

I agree with all the above, but I also say you could perform a permutation test instead of a t-test. since this question often arises as a part of the final project, I don't actually recommend they get into this for the project, but I think pointing it out helps students feel a bit more comfortable with why we learned two different approaches to hypothesis testing in general. because one of them is quite useful when the assumptions behind the form of the null hypothesis distribution break down!