KirstensGitHub
commented
5 years ago CHECK D, both experiments
You can view the tests where we've replaced cued composite images with images of fruit, below.
You can see by viewing the corresponding dataframes that the cued and uncued composites display on the cued and uncued sides, respectively, that the arrows display in the order shown in the csv file.
SUSTAINED ATTENTION
Here is video and dataframe saved out for run 1 from the sustained attention fruit version:
https://www.youtube.com/watch?v=l8P5ycLB53Y&feature=youtu.be
| Subject | Trial Type | Run | Cued Composite | Uncued Composite | Cued Face | Cued Place | Uncued Face | Uncued Place | Memory Image | Category | Cued Side | Cued Category | Attention Reaction Time (s) | Familiarity Reaction Time (s) | Familiarity Rating | Attention Level | Cue Validity | Post Invalid Cue | Pre Invalid Cue | Attention Button | Rating History | Stimulus Onset | Stimulus End | Attention Probe | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 50 | kirsten_fruit2 | Presentation | 1 | apple.jpg | 00479940519fa_sunabxsbfwjccqxxzxq.jpg | 00198940128fb.jpg | sunaazezcsunmhttzxz.jpg | 00479940519fa.jpg | sunabxsbfwjccqxxzxq.jpg | nan | nan | > | Place | 0.735108137 | nan | nan | nan | 1 | nan | nan | 1 | nan | 1566430562 | 1566430565 | x |
| 51 | kirsten_fruit2 | Presentation | 1 | pear.jpg | 00630941031fa_sunadakkdovnuzlycvp.jpg | 00568940928fa.jpg | sunacsdhbbsybcyxnel.jpg | 00630941031fa.jpg | sunadakkdovnuzlycvp.jpg | nan | nan | > | Place | 0.717167139 | nan | nan | nan | 1 | nan | nan | 1 | nan | 1566430567 | 1566430570 | x |
| 52 | kirsten_fruit2 | Presentation | 1 | melon.jpg | 00862940307fa_sunaizgnnplsvajzhkc.jpg | 00997960627fa.jpg | sunbtpilbhhbmhmeuzq.jpg | 00862940307fa.jpg | sunaizgnnplsvajzhkc.jpg | nan | nan | > | Place | 0.601085901 | nan | nan | nan | 1 | nan | nan | 1 | nan | 1566430572 | 1566430574 | x |
| 53 | kirsten_fruit2 | Presentation | 1 | starfruit.jpg | 00847940307fa_sunaivdjruhkrfywfed.jpg | 00086931230fa.jpg | sunaafynehyrzpsoaml.jpg | 00847940307fa.jpg | sunaivdjruhkrfywfed.jpg | nan | nan | > | Place | 0.33427 | nan | nan | nan | 1 | nan | nan | 1 | nan | 1566430576 | 1566430579 | x |
| 54 | kirsten_fruit2 | Presentation | 1 | passion_fruit.jpg | 00158931230fb_sunaavchcbptaerhcfy.jpg | 00961960627fa.jpg | sunawotxrevnqvamsfp.jpg | 00158931230fb.jpg | sunaavchcbptaerhcfy.jpg | nan | nan | > | Place | 0.367249012 | nan | nan | nan | 1 | nan | nan | 1 | nan | 1566430581 | 1566430584 | o |
| 55 | kirsten_fruit2 | Presentation | 1 | pineapple.jpg | 00194940128fb_sunaayehfdqcyxggsej.jpg | 00090931230fa.jpg | sunaahedjlmtqekgyvj.jpg | 00194940128fb.jpg | sunaayehfdqcyxggsej.jpg | nan | nan | > | Place | 0.335178852 | nan | nan | nan | 1 | nan | nan | 1 | nan | 1566430585 | 1566430588 | o |
| 56 | kirsten_fruit2 | Presentation | 1 | watermelon.jpg | 00938960627fa_sunaqyylsngywqzwfmx.jpg | 00197940128fa.jpg | sunaaylzyqlqrsmfwif.jpg | 00938960627fa.jpg | sunaqyylsngywqzwfmx.jpg | nan | nan | > | Place | 0.500993967 | nan | nan | nan | 1 | nan | nan | 1 | nan | 1566430590 | 1566430593 | o |
| 57 | kirsten_fruit2 | Presentation | 1 | banana.jpg | 00127931230fa_sunaampvucecsfbdafn.jpg | 00782941205fa.jpg | sunagfvluwixdsozaql.jpg | 00127931230fa.jpg | sunaampvucecsfbdafn.jpg | nan | nan | > | Place | 0.434042931 | nan | nan | nan | 1 | nan | nan | 1 | nan | 1566430595 | 1566430598 | o |
| 58 | kirsten_fruit2 | Presentation | 1 | coconut.jpg | 00218940128fa_sunabbwggenhfbftyvi.jpg | 00836940307fa.jpg | sunainqelldeebvxtcz.jpg | 00218940128fa.jpg | sunabbwggenhfbftyvi.jpg | nan | nan | > | Place | 0.53357482 | nan | nan | nan | 1 | nan | nan | 1 | nan | 1566430599 | 1566430602 | x |
| 59 | kirsten_fruit2 | Presentation | 1 | orange.jpg | 00557940519fa_sunachtuarilwyqnvjx.jpg | 00778941205fa.jpg | sunagcthdfirrcawoic.jpg | 00557940519fa.jpg | sunachtuarilwyqnvjx.jpg | nan | nan | > | Place | 0.55121994 | nan | nan | nan | 1 | nan | nan | 1 | nan | 1566430604 | 1566430607 | x |
VARIED ATTENTION
Here is the video and dataframe saved out for run 1 from the variable attention fruit version:
https://www.youtube.com/watch?v=oSI17cgCae0&feature=youtu.be
| Subject | Trial Type | Run | Cued Composite | Uncued Composite | Cued Face | Cued Place | Uncued Face | Uncued Place | Memory Image | Category | Cued Side | Cued Category | Attention Reaction Time (s) | Familiarity Reaction Time (s) | Familiarity Rating | Attention Level | Cue Validity | Post Invalid Cue | Pre Invalid Cue | Attention Button | Rating History | Stimulus Onset | Stimulus End | Attention Probe | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 50 | kirsten_fruit_1 | Presentation | 1 | apple.jpg | 00925960627fa_sunapqwnqzxlsfvgsjm.jpg | 00557940519fa.jpg | sunachtuarilwyqnvjx.jpg | 00925960627fa.jpg | sunapqwnqzxlsfvgsjm.jpg | nan | nan | > | Place | 0.43501687 | nan | nan | nan | 0 | nan | nan | 1 | nan | 1566430449 | 1566430452 | x |
| 51 | kirsten_fruit_1 | Presentation | 1 | pear.jpg | 00090931230fa_sunaahedjlmtqekgyvj.jpg | 00264940128fb.jpg | sunabjzyxcjnmztdonj.jpg | 00090931230fa.jpg | sunaahedjlmtqekgyvj.jpg | nan | nan | > | Place | 0.38481307 | nan | nan | nan | 1 | nan | nan | 1 | nan | 1566430457 | 1566430460 | o |
| 52 | kirsten_fruit_1 | Presentation | 1 | melon.jpg | 00725941201fa_sunaefgzwiramypjvtd.jpg | 00116931230fa.jpg | sunaakqepfoeqomfgxf.jpg | 00725941201fa.jpg | sunaefgzwiramypjvtd.jpg | nan | nan | < | Place | 0.600998878 | nan | nan | nan | 1 | nan | nan | 1 | nan | 1566430464 | 1566430467 | o |
| 53 | kirsten_fruit_1 | Presentation | 1 | starfruit.jpg | 00778941205fa_sunagcthdfirrcawoic.jpg | 00931960627fa.jpg | sunaptrqvaooxfvktvw.jpg | 00778941205fa.jpg | sunagcthdfirrcawoic.jpg | nan | nan | > | Face | 0.567201853 | nan | nan | nan | 1 | nan | nan | 1 | nan | 1566430471 | 1566430474 | x |
| 54 | kirsten_fruit_1 | Presentation | 1 | passion_fruit.jpg | 00880960530fa_sunakmnfgklupjijsgf.jpg | 00235940128fb.jpg | sunabclssnoeuigtawp.jpg | 00880960530fa.jpg | sunakmnfgklupjijsgf.jpg | nan | nan | > | Place | 0.668167114 | nan | nan | nan | 1 | nan | nan | 1 | nan | 1566430479 | 1566430482 | o |
| 55 | kirsten_fruit_1 | Presentation | 1 | pineapple.jpg | 01007960627fa_sunbxarcshsnqsefemx.jpg | 00882960530fa.jpg | sunaknlirqjqiwbbeeg.jpg | 01007960627fa.jpg | sunbxarcshsnqsefemx.jpg | nan | nan | < | Face | 0.501296043 | nan | nan | nan | 1 | nan | nan | 1 | nan | 1566430486 | 1566430489 | o |
| 56 | kirsten_fruit_1 | Presentation | 1 | watermelon.jpg | 00818940307fa_sunahpblecxtmuzkmxb.jpg | 00065931230fb.jpg | sunaaemixhfquhnxxlm.jpg | 00818940307fa.jpg | sunahpblecxtmuzkmxb.jpg | nan | nan | < | Place | 0.417265892 | nan | nan | nan | 1 | nan | nan | 1 | nan | 1566430493 | 1566430496 | o |
| 57 | kirsten_fruit_1 | Presentation | 1 | banana.jpg | 00815941205fa_sunahiphsekjihkafsl.jpg | 00675941121fa.jpg | sunadoxcchtmsxewsau.jpg | 00815941205fa.jpg | sunahiphsekjihkafsl.jpg | nan | nan | < | Face | 0.41869688 | nan | nan | nan | 1 | nan | nan | 1 | nan | 1566430501 | 1566430504 | o |
| 58 | kirsten_fruit_1 | Presentation | 1 | coconut.jpg | 00978960627fa_sunbddbivbptlrlauhy.jpg | 00884960530fa.jpg | sunakodkcslgqhqlgwl.jpg | 00978960627fa.jpg | sunbddbivbptlrlauhy.jpg | nan | nan | > | Face | 0.417073965 | nan | nan | nan | 1 | nan | nan | 1 | nan | 1566430508 | 1566430511 | x |
| 59 | kirsten_fruit_1 | Presentation | 1 | orange.jpg | 00862940307fa_sunaizgnnplsvajzhkc.jpg | 00097931230fa.jpg | sunaajayojuslbbnneg.jpg | 00862940307fa.jpg | sunaizgnnplsvajzhkc.jpg | nan | nan | < | Face | 0.868084192 | nan | nan | nan | 1 | nan | nan | 1 | nan | 1566430515 | 1566430518 | x |
WHAT WE'RE CHECKING:
These tests check to make sure all stimulus presentation info (order of stimuli, onset and offset times) and participant responses (key presses, reaction times, etc.) in our behavioral data files accurately reflect what happened during the experiment.
INITIAL CHECKS (complete):
For this check, I ran myself on a presentation block and memory block of the experiment and saved out behavioral data files with the original code, as well as psychopy log files, using new lines of code to mark first screen refreshes displaying each stimulus. I then compared all stimulus info and participant data info across the two files. I also made a toy example where I replaced some of our stimuli with pictures of food, to test our stimulus presentation ordering and locations.
All checks and sample data can be viewed in the PDF's, zip files, and videos below.
Check A: We found that the same image stimuli were recorded in the same order in both the csv and log files.
Check B: We found that there were differences between the image onset and offset times in the log and csv files, by fractions of a second. Notably, the cued-side composite images displayed ~14 milliseconds (one screen refresh) before the uncued-side composites.
Check C: We found that participant responses were the same in the csv and log files, and the participant response reaction times also matched, within approximately four decimal places.
CHECK D: We visually checked that the cued composite images always appear on the cued side of the screen by replacing cued composites with images of fruit. You can see the videos and their corresponding stimulus dataframes below. You can see that the fruit images always appear in the cued location.
CHECK E: We also ran two runs of each experiment to fully explore how often the
xandostimuli appear on the cued and uncued sides. For each experiment, we ran one run (run #6) where the attention probes were intended to be 100% valid, and one run (run #7) in which the probes were intended to be 100% invalid. We find that both trials are as expected in the sustained attention experiment, but, in the varied attention experiment, run #7 has 50% valid attention probes.CHECK F: We also checked the proportion and order of the attention cues for both experiments. We found that in Experiment 1 each subject saw two of each cue type, as desired, but that some participants saw the same attention cues in two consecutive blocks. In Experiment 2, participants saw an equal number of Right/ Left and Face/ Place cues in each block, with the desired proportions of each cue, but not all subjects saw each cue in the same proportion across the entire experiment.
SUMMARY OF CHANGES: Updated window flips and timing recording. Updated invalid cuing for experiment 2 to check the cued side on a trial-by-trial basis. Prevent same attention cues back-to-back in sustained attention blocks. Ensure each individual cue seen an equal number of times across entire experiment in Experiment 2.
FINAL CHECK To see the same checks completed after the code updates, see Issue 91