IMPORT fernald_marchman_2012

[adriansteffan]

• [x] Fix validator issue: trial types are not unique.
• [x] Fix validator issue: trials order values are not unique within administrations
• [ ] (TODO) Fix full phrases (information exists in misc files in the raw data)
• [ ] (TODO) Fix image linking - we need to create a mapping of the target label to the stimuli images in the raw data
• [x] (TODO) check if the (u)r-prime-verb rows are save to remove e.g. do they always have a noun partner?
• [x] We should have a quick look at the tr_num values to make sure that indeed multiple trial runs (with resetting tr_num) were shown during each administration of the original experiment - solved, the ordering is just weird in general
• [x] There is some exploration/discussion to be had whether we want to include more conditions as vanilla trials (medial, adjectives, and what is ferret?)
• [x] last meeting we agreed to use the provided PODs for the vanilla trials - but the code mentions that the raw data is already centered and the looking score graph looks decent. Did I miss something?

[adriansteffan]

Checklist for code review v2024

To start:

• [ ] Git pull this repo to get the latest version
• [ ] Update your peekds and peekbankr to the latest version
  • [ ] Be sure to restart your R Session to apply these updates
• [ ] Get the latest version of the dataset from osf (delete your raw_data, so that the script automatically downloads the data)
• [ ] Run the import script
• [ ] Does it run into issues due to missing libraries? during restructuring, import statements for libraries like janitor might have been lost in some datasets - re-add them if necessary
• [ ] Does the validator complain about the processed data? Complain to Adrian (or fix the listed issues if you feel like it)

Common issues to check:

Trials

• [ ] Are trials now unique between administrations?
• [ ] Is exclusion info handled correctly? (look closely at how exclusion information is marked)

Trial Types

• [ ] Check if the trial type IDs are created independently of administrations/subjects
• [ ] Is vanilla_trial coded appropriately?

Stimuli

• [ ] If the images are on osf, make sure the image path contains the image path on osf
• [ ] Make sure each row represents a label-image association
  • [ ] the labels should be the words that the participants hear. For example, "apple" is okay, "red_apple_little" is wrong and was probably erroneously extracted from the file name
• [ ] Are there items in the imported dataset not mentioned in the paper?
• [ ] Are distractors represented correctly?
  • Special explanation for distractors: If an item only ever appeared in distractor position, it still gets its own row. The label is typically the label given to the image in the experiment description (e.g., "the distractor was an image of a chair"). If there is no obvious label provided in the experiment design, leave label blank.

Subjects

• [ ] Does CDI data follow the new aux_data format?
• [ ] Age rounded correctly? (decision: we do no rounding)

General

• [ ] Double-check the citation and update it in the dataset table and make sure it’s consistent with the peekbank datasets google sheet: peekbank datasets
• [ ] Are there any TODOs left in the code - resolve/double check
• [ ] Review (or add) a ReadME (example)
  • [ ] Make sure any TO-DOs or other decision points in the comments of the code are documented in the ReadMe AND removed from the code to prevent ambiguity
• [ ] General data sanity-checking (summary output helps here)
  • [ ] is there are the general numbers (e.g. # of participants, # of stimuli, average trials per administratoin) in the summary consistent with the paper? aoi_timepoints are hard to gague, but a super small number is probably bad
  • [ ] is the subject summary (age, sex distribution) approximately consistent with the paper? (note that it is not surprising if it is not identical - often we have a slightly different dataset and are not trying reproduce the exact numbers)
  • [ ] is the target side distribution skewed towards one side?
  • [ ] any weird trial durations?
  • [ ] do the cdi rawscore numbers match the instrument and measure?
  • [ ] is the exclusion % and the exclusion reasons sensible? (bearing in mind that we only have exclusion info for some datasets)
  • [ ] Inspect the timecourse and accuracy plots/output at the end of the import:
    • [ ] Compare timecourse patterns with paper (as best as possible)
    • [ ] Does the timing seem right? (accuracy spike later than PoD might be sensible, earlier is suspicious)
    • [ ] (if multiple conditions) Does the number conditions make sense in the context of the paper?
    • [ ] (if multiple conditions) Are the overall accuracies for conditions vastly different in a way not explained by the paper?
    • [ ] Any odd item-level patterns?
    • [ ] Any odd subject-level patterns?
  • [ ] Any large (unexpected) discrepancies between data reported in paper vs. data in the imported dataset?
• [ ] After checking everything and rerunning the script: Upload the output to osf

[vboyce]

images have now been uploaded to osf -- note that for each thing like "baby1" there are different versions based on what age it was and whether it was shown on left or right. (some of these are actual duplicates of each other, but others are not)

Someone will need to fix stimuli uniqueness and fix linking to images