0todd0000
commented
1 year ago If I find an interaction over a specific region when running a 3-way ANOVA (say AxC in the attached image at 20 - 25 % of the time series), can I ONLY report post hoc differences either within, or overlapping this region?
For post hoc analysis You can analyze and report anything provided it does not contradict the main ANOVA results.
A previous message in the forum states the following, so I'm assuming the region in my initial 3way test constitutes the region of interest (ROI) , soI ONLY report specific post hoc differences in/overlapping the ROI
Yes, you can use an ROI in this manner. ROIs often pertain to a priori hypotheses, but they can indeed be used to constrain post hoc analyses as you suggest. However, one problem with this approach is that it artificially increases power (i.e., lowers the critical threshold); the smaller the ROI the greater the power, so you will be more and more likely to reach the critical threshold as you shrink the ROI. Regardless, the best general approach is (as above): ensure that your reported post hoc analyses do not contradict the main ANOVA results.
And so would this mean that, whereas plotting 95 % CIs for my two bouts (B, above - within measures) shows a lack of overlap at both 35 - 50 % AND 55 - 80 % of the time series, I only report that SPM identified a difference at 60 - 75 %?
Yes, this sounds fine. However, note that a lack of overlap in CIs does not imply significant difference unless the CIs are calculated in the appropriate design-dependent manner. Please refer to "Appendix F: Confidence interval design dependence" in the following paper: https://www.researchgate.net/publication/273576725 In your case you'd need to calculate CIs with a three-way interaction model. Note that this type of CI calculation is not directly supported in spm1d.
freddybrown1984
Hello again, Todd. Happy New Year!
Searching through your forum, I think I have found the answer to my question, but just wanted to be sure. Sorry if this creates extra work/spam
If I find an interaction over a specific region when running a 3-way ANOVA (say AxC in the attached image at 20 - 25 % of the time series), can I ONLY report post hoc differences either within, or overlapping this region? A previous message in the forum states the following, so I'm assuming the region in my initial 3way test constitutes the region of interest (ROI) , soI ONLY report specific post hoc differences in/overlapping the ROI
> Here are two thoughts:
And so would this mean that, whereas plotting 95 % CIs for my two bouts (B, above - within measures) shows a lack of overlap at both 35 - 50 % AND 55 - 80 % of the time series, I only report that SPM identified a difference at 60 - 75 %?