langcog / experimentology

Experimentology textbook
https://langcog.github.io/experimentology/
Other
42 stars 18 forks source link

Consider including brief variance + correlation primer in 7.1.2 “Paradoxes in reliability” #28

Closed kateptrv closed 10 months ago

kateptrv commented 3 years ago

I really like the examples and the explanations used here, but the success of these examples relies on your readers having a clear understanding of (a) what variance is and (b) the fact that correlation is based on the rank-ordering of observations. Many students don’t become fluent with these ideas (e.g., struggle to define variance; have trouble understanding why a high correlation between t1 and t2 is about the relative standing of observations in the sample and not the actual amount of change) until they take an advanced regression course. I wonder if a basic primer on variance and correlation would be helpful to include here? Happy to share some ideas.

mcfrank commented 3 years ago

Very good suggestion. We may try and work it into ch 4!

On Sun, Oct 3, 2021 at 11:56 AM Kate Petrova @.***> wrote:

I really like the examples and the explanations used here, but the success of these examples relies on your readers having a clear understanding of (a) what variance is and (b) the fact that correlation is based on the rank-ordering of observations. Many students don’t become fluent with these ideas (e.g., struggle to define variance; have trouble understanding why a high correlation between t1 and t2 is about the relative standing of observations in the sample and not the actual amount of change) until they take an advanced regression course. I wonder if a basic primer on variance and correlation would be helpful to include here? Happy to share some ideas.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/langcog/experimentology/issues/28, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAI25FZMB6XUCSZF65QPA43UFCROTANCNFSM5FH43MYQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

-- Mike

mcfrank commented 2 years ago

@mayamathur do you think we should write about correlation in the Estimation chapter? Seems maybe useful given that we start from nothing on other concepts...

mayamathur commented 2 years ago

That might be good, and should be easy given the existing material about regression. Could just frame r as betahat * (SD(X) / SD(Y)), which seems nicely intuitive.

mcfrank commented 10 months ago

@mayamathur I pushed some changes including a short correlation primer. I made a few minor tweaks to 5.1.1, and then 5.3 is the new section. I wonder if you could review this when you get a chance? thanks!!

mayamathur commented 10 months ago

Yes, will do!

On Tue, Dec 19, 2023 at 5:05 PM Michael Frank @.***> wrote:

@mayamathur https://github.com/mayamathur I pushed some changes including a short correlation primer. I made a few minor tweaks to 5.1.1, and then 5.3 is the new section. I wonder if you could review this when you get a chance? thanks!!

— Reply to this email directly, view it on GitHub https://github.com/langcog/experimentology/issues/28#issuecomment-1863681703, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACEE6HQT4L7A4A4AZEZ3JGTYKI2VTAVCNFSM5FH43MY2U5DIOJSWCZC7NNSXTN2JONZXKZKDN5WW2ZLOOQ5TCOBWGM3DQMJXGAZQ . You are receiving this because you were mentioned.Message ID: @.***>

--

Maya Mathur Assistant Professor Quantitative Sciences Unit https://med.stanford.edu/qsu.html, Biomedical Informatics Research Division Associate Director, Center for Open and Reproducible Science https://datascience.stanford.edu/cores Stanford University Website http://www.mayamathur.com

https://med.stanford.edu/profiles/maya-mathur