search

HEGSRR / OR-Replicability-in-Geography-Survey

BSD 3-Clause "New" or "Revised" License
0 stars 0 forks source link

Q23 - Poor Question #6

Closed Peter-Kedron closed 1 year ago

Peter-Kedron commented 1 year ago

Our response to Q23 may be unusable, which is a real shame. I think the respondents read it as, can you find replication studies in the literature. That then caused confusion when responding to Q23_text because we asked them how they would evaluate whether a specific study was replicated. Almost no one provided information on how they would assess whether the claims was replicated.

We may be able to use the check box response to measure whether researchers thought they could find a replication of a study. However, most responded "I don't know", which suggests to me they are thinking "well it depends on the study, the field it is in, ..." You can see this some in the text responses.

josephholler commented 1 year ago

I think this reflects a high level of uncertainty in our field around replications, and makes a great topic for a future workshop. Can we close the comment for now?

Peter-Kedron commented 1 year ago

Sarah had a good idea about quantifying differences in reproductions using FE or RE models. We should discuss that as well. Replication is more difficult and a good topic for some future work.