Brian-Elbel-s-Research-Projects / project-overview

A summary of current and past research projects in Elbel lab
0 stars 0 forks source link

Testing the equality of DiD coefficients #55

Closed lloydheng closed 1 year ago

lloydheng commented 2 years ago

Talk through whether this approach sounds right:

Example testing equality between taco and burrito DiD coefficients:

  1. Get monthly DiD estimates for taco and burrito.
  2. Do a paired t-test using estimates in the first year, extracting the p-value. This tells us if the pair-wise monthly coefficients in the first year are significantly different between tacos and burritos.
  3. Repeat for the second-year estimates.
  4. Adopt some kind of correction for the numerous pair-wise comparisons/hypotheses we're testing. Bonferroni correction = divide the significant threshold by the number of within-category comparisons we're making. So, if we're comparing 5 item categories, the threshold is now $${0.05 \over 5} = 0.01 $$

This, versus just looking at the CIs give us quite different conclusions.

lloydheng commented 1 year ago

Testing z-test instead.