lookit / lookit-docs

Documentation for Lookit project, including use of platform and lookit-api, ember-lookit-frameplayer, and exp-addons repos.
MIT License
2 stars 369 forks source link

Add "Requirements" for inclusion/exclusion from old CHS into docs #312

Open msheskin opened 1 year ago

msheskin commented 1 year ago

A page on the old CHS website (https://childrenhelpingscience.com/requirements) listed our requirements for using inclusion/exclusion criteria. This information should be included in our docs. Importantly, a "standard comment" from the admin review template links to it, because it gets used a lot. We might also add information about this to a self-review checklist. Here is the text from the old page:

Information about Inclusion/Exclusion Criteria Our website strongly encourages inclusive practices for families that want to participate in research studies. Our goals are to support great experiences for all families and wide-reaching science outreach. Importantly, there can be a difference between (1) who you allow to experience your study and (2) who you include in your final dataset.

Thus, we suggest that you have inclusion criteria that are as broad as possible. In general:

A guiding principle you can use is to consider what percent of your potential participants a criteria would exclude. For example, you might want to exclude children with “History of head injury” but this can almost certainly be done in your dataset AFTER participation has occurred; you would allow children to participate without any mention of this, but then at the end ask a question about head injury (and any other similar questions) and exclude the data from your dataset in whatever way you pre-planned. In contrast, imagine that you were specifically recruiting children WITH a history of head injury. This would be appropriate to list as an inclusion criterion, because to recruit your sample without stating this you would need to recruit a massive sample and then exclude the vast majority of the children who had participated (and who did not have a history of head injury).

In short, you will only be able to list criteria on our website when you make a strong case for it, including that it would be impractical/impossible to allow families to participate and then exclude their data from your dataset at the point of data analysis.

All of this means that you might choose to not list your study on our website, if you are going to turn away many families rather than allowing them to experience your study.

becky-gilbert commented 1 year ago

Thanks @msheskin! I'd be happy to add this to the docs, but I'll wait to get approval/comments from @mekline.