Metafor results vary significantly with each new run

openplantpathology / Mungbean_PM

A meta-analysis of mungbean powdery mildew control fungicide efficacy trials

https://openplantpathology.github.io/Mungbean_PM/

Creative Commons Zero v1.0 Universal

1 stars 0 forks source link

Metafor results vary significantly with each new run #22

Closed PaulMelloy closed 4 years ago

PaulMelloy commented 4 years ago

Hello, I have noticed that each time we impute the mean squares and run the metafor model I get different results.

I have added a code chunk following the analysis to show this at the following line.

I would really like to discuss how to deal with this so I can move forward when interpreting the results. What are your thought @adamhsparks and @emdelponte ?

https://github.com/openplantpathology/Mungbean_PM/blob/3b9f9952a0584d0b8b8395180fed9d33b80b4c94/04_MetaAnalysis.Rmd#L246

emdelponte commented 4 years ago

Is not that expected if you are not using a fixed seed ?

PaulMelloy commented 4 years ago

To follow up on this issue, we have decided to drop the three trials which don't report any error from the analysis. This allows better reproducibility