worldbank / dime-data-handbook

Development Research in Practice: The DIME Analytics Data Handbook. By Kristoffer Bjärkefur, Luíza Cardoso de Andrade, Benjamin Daniels, and Maria Jones
https://worldbank.github.io/dime-data-handbook/
Other
63 stars 26 forks source link

Ch #1: Peer Review #536

Open MrMaksimize opened 3 years ago

MrMaksimize commented 3 years ago

Hi DIME team,

I'm very glad to provide a review of this document. Overall, it's very exciting to see the breadth of topics you cover, and how you have been able to provide a good level of detail, without going too deep into the weeds.

Comments below: I LOVE this chapter. I love the idea of teams pre-registering their research, and keeping track of how they collect their data.
I'm going to caveat what I say next with this: I have never done an actual research project that went anywhere near ending up in a journal. So these points may be irrelevant. Nevertheless:

As a researcher, I likely need to estimate what the lifecycle of my project will look like. While I may be able to estimate with a reasonable amount of accuracy how long a given analysis will take, it seems that it will be really hard for me to estimate all the steps I typically don't do/don't know. (Since I've never done them, I have no idea what level of effort is required).

Furthermore, I am likely somewhat fuzzy on what flow - what steps have to happen when.

Having said that, I would love to see some or all of the following included:

I also love that you provide a Pre-Analysis Plan Template but it's buried in the wiki link - and I think it should be more prominent.

Thank you!!