PsyTeachR / glossary

Glossary of terms
https://psyteachr.github.io/glossary/
Other
15 stars 17 forks source link

EDIT: p-value #79

Open JulianeKloidt opened 2 years ago

JulianeKloidt commented 2 years ago

I would suggest adding some caution statement linking the p-value to assumptions of the statistical model:

P-Value (= observed significance level) is a statistical summary of the compatibility between the observed data and what we would predict or expect to see if we knew the entire statistical model (all the assumptions used to compute the P value) were correct. The P value tests all the assumptions about how the data were generated, not just the targeted hypothesis it is supposed to test (e.g. null hypothesis). The P value assumes all assumptions (including the test hypothesis) are true. A p-value represents a conditional probability given that H0 is correct. P-values do not provide information about H1.

debruine commented 2 years ago

Thanks! Can we use that text directly?

JulianeKloidt commented 2 years ago

yes, it's from my course notes from the Bootstrap module with Guillaume in 2020

debruine commented 2 years ago

I find this bit a little confusing. How are you mapping "targeted hypothesis", "null hypothesis" and "test hypothesis" onto H0 and H1?

The P value tests all the assumptions about how the data were generated, not just the targeted hypothesis it is supposed to test (e.g. null hypothesis). The P value assumes all assumptions (including the test hypothesis) are true.