Watts-College / cpp-527-spr-2022

https://watts-college.github.io/cpp-527-spr-2022/
0 stars 1 forks source link

Testing for Statistical Significance #14

Closed dholford closed 2 years ago

dholford commented 2 years ago

For Lab 2 Part 2 we are asked about the "dominant" strategy. In the scenario where there are 5 goats and 2 cars my table looked like this: outcome strategy LOSE WIN stay 0.72 0.28 switch 0.66 0.34

I then starting thinking, well, ultimately I'd want to know if the difference in win % between staying and switching was actually statistically significant. I have to admit, I don't remember exactly how to figure that out. I started by looking for ways to do this in R, and was playing around with t.test() I realized, though, that in running 10,000 games we still ended with 1 mean. To actually run a t.test, we would want a distribution of means. So we would need to run another loop, or connect another loop to the current functions to calculate the mean win % for stay and switch for a given scenario and do that over and over so we ended up with enough means to run a t-test.

I'm I thinking about that correctly?

Dselby86 commented 2 years ago

Hi Dylan

You can also think of the t test as having a mean of your stay/switch win percent and a sample size of 1000

On Sun, Jan 23, 2022, 9:16 PM dholford @.***> wrote:

For Lab 2 Part 2 we are asked about the "dominant" strategy. In the scenario where there are 5 goats and 2 cars my table looked like this: outcome strategy LOSE WIN stay 0.72 0.28 switch 0.66 0.34

I then starting thinking, well, ultimately I'd want to know if the difference in win % between staying and switching was actually statistically significant. I have to admit, I don't remember exactly how to figure that out. I started by looking for ways to do this in R, and was playing around with t.test() I realized, though, that in running 10,000 games we still ended with 1 mean. To actually run a t.test, we would want a distribution of means. So we would need to run another loop, or connect another loop to the current functions to calculate the mean win % for stay and switch for a given scenario and do that over and over so we ended up with enough means to run a t-test.

I'm I thinking about that correctly?

— Reply to this email directly, view it on GitHub https://github.com/Watts-College/cpp-527-spr-2022/issues/14, or unsubscribe https://github.com/notifications/unsubscribe-auth/AB4EHB2BBCDWYUC2D4CKLS3UXTHBJANCNFSM5MUJ243Q . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

You are receiving this because you are subscribed to this thread.Message ID: @.***>

dholford commented 2 years ago

Got it, I think I can figure it out from there.

Thanks!