OpenIntroStat / oilabs-tidy

👩🏿‍💻 OpenIntro Labs in R using the tidyverse design philosophy, grammar, and data structures
http://openintrostat.github.io/oilabs-tidy/
Creative Commons Attribution Share Alike 4.0 International
66 stars 85 forks source link

Inference for categorical data lab #29

Closed rudeboybert closed 8 years ago

rudeboybert commented 8 years ago

In the On Your Own section, Q1.a) you ask students to "Form confidence intervals for the true proportion of atheists in both years, and determine whether they overlap." I think a better approach is via a single confidence interval on the difference in proportions.

Even though two individual confidence intervals may overlap, suggesting they are not different, the confidence interval of the difference might still suggest they are in fact different. (If you need an example of this, let me know) This is a common misinterpretation of bar plots with error bars (i.e. dynamite plots).

rpruim commented 8 years ago

+1

AmeliaMN commented 8 years ago

We just did this lab in my class and I want to second (or third!) this comment. In fact, because we have talked in lecture about inference for the difference in proportions my students were baffled about why we were forming two different CIs. Then, when Q2 asks you to find the Type I error we had a lot of conversation about what that would actually be, given that the standard errors were different, the intervals could overlap in different ways, etc.

I encouraged my students to think about Q2 in the context of a set of tests about difference in proportions, which makes the Type I error much easier to think about. But, I think the confusion would be cleared up by changing this lab entirely to be about differences in proportions!

mine-cetinkaya-rundel commented 8 years ago

To be honest I have no idea how this question even made it in the release, or past any edits. And I agree it's completely wrong to do it this way. Thanks for raising the issue here so that we don't miss it in the revision stage.

beanumber commented 8 years ago

If memory serves this was inserted because @andrewpbray and I hadn't made it to difference of two proportions when it came time to teach this lab. But it is kind of a mess now.

mine-cetinkaya-rundel commented 8 years ago

This has been removed in the most recent version of the labs.