search

RAP-group / guide_to_open_science

A guide to open science and reproducibility for students, advisors, and early career researchers
https://doi.org/10.31234/osf.io/spz4w
0 stars 0 forks source link

R2: preregistration, Explain coretta et al #56

Open jvcasillas opened 1 month ago

jvcasillas commented 1 month ago
  • Coretta et al. 2023: Please explain in a few sentences what the study did and what it showed; it is impossible to understand (and appreciate) that without knowing the study.

TODO

GaboSJW commented 3 weeks ago

This type of flexibility, referred to as "researcher degrees of freedom," can significantly impact quantitative research, particularly in fields like linguistics. For instance Coretta et al. (2023) conducted a study providing the same speech-production data set to 46 research teams with the task to answer the same research question. Their findings revealed substantial variability in the reported effect sizes and their interpretations. Furthermore, using Bayesian meta-analytic tools, they showed that this variability could not be explained by analysts' prior beliefs, expertise, or the perceived quality of their analyses.