courtois-neuromod / shinobi

subdataset of Courtois-neuromod project with task of playing ShinobiIII game in the MRI
1 stars 0 forks source link

Some events.tsv point toward duplicate files : #33

Closed hyruuk closed 1 year ago

hyruuk commented 1 year ago

The raw events_files contain duplicates, which were transfered to the BIDS formatted dataset. We might have lost some data, since these duplicates are already present in the .log file (suggesting that the two repetitions were saved under the same name at acquisition).

Here's a list of duplicates provided by @FrancoisPgm :

sub-04_ses-shinobi_009_20210311-090537_ShinobiIIIReturnOfTheNinjaMaster-Genesis_Level1-0_001
data/shinobi/sub-04/ses-009/func/sub-04_ses-009_task-shinobi_run-02_events.tsv
data/shinobi/sub-04/ses-009/func/sub-04_ses-009_task-shinobi_run-01_events.tsv
=======================================================
sub-04_ses-shinobi_006_20210218-091829_ShinobiIIIReturnOfTheNinjaMaster-Genesis_Level1-0_001
data/shinobi/sub-04/ses-006/func/sub-04_ses-006_task-shinobi_run-02_events.tsv
data/shinobi/sub-04/ses-006/func/sub-04_ses-006_task-shinobi_run-01_events.tsv
=======================================================
sub-04_ses-shinobi_002_20210121-091841_ShinobiIIIReturnOfTheNinjaMaster-Genesis_Level1-0_002
data/shinobi/sub-04/ses-002/func/sub-04_ses-002_task-shinobi_run-03_events.tsv
data/shinobi/sub-04/ses-002/func/sub-04_ses-002_task-shinobi_run-02_events.tsv
=======================================================
sub-02_ses-shinobi_007_20201029-111418_ShinobiIIIReturnOfTheNinjaMaster-Genesis_Level4-1_003
data/shinobi/sub-02/ses-007/func/sub-02_ses-007_task-shinobi_run-04_events.tsv
data/shinobi/sub-02/ses-007/func/sub-02_ses-007_task-shinobi_run-05_events.tsv
=======================================================
sub-02_ses-shinobi_007_20201029-111418_ShinobiIIIReturnOfTheNinjaMaster-Genesis_Level5-0_003
data/shinobi/sub-02/ses-007/func/sub-02_ses-007_task-shinobi_run-04_events.tsv
data/shinobi/sub-02/ses-007/func/sub-02_ses-007_task-shinobi_run-05_events.tsv
=======================================================
sub-02_ses-shinobi_007_20201029-111418_ShinobiIIIReturnOfTheNinjaMaster-Genesis_Level1-0_004
data/shinobi/sub-02/ses-007/func/sub-02_ses-007_task-shinobi_run-04_events.tsv
data/shinobi/sub-02/ses-007/func/sub-02_ses-007_task-shinobi_run-05_events.tsv
=======================================================
sub-02_ses-shinobi_012_20201130-103844_ShinobiIIIReturnOfTheNinjaMaster-Genesis_Level1-0_004
data/shinobi/sub-02/ses-012/func/sub-02_ses-012_task-shinobi_run-04_events.tsv
data/shinobi/sub-02/ses-012/func/sub-02_ses-012_task-shinobi_run-03_events.tsv
=======================================================
sub-02_ses-shinobi_012_20201130-103844_ShinobiIIIReturnOfTheNinjaMaster-Genesis_Level1-0_005
data/shinobi/sub-02/ses-012/func/sub-02_ses-012_task-shinobi_run-05_events.tsv
data/shinobi/sub-02/ses-012/func/sub-02_ses-012_task-shinobi_run-04_events.tsv
=======================================================
sub-02_ses-shinobi_015_20201217-090727_ShinobiIIIReturnOfTheNinjaMaster-Genesis_Level1-0_002
data/shinobi/sub-02/ses-015/func/sub-02_ses-015_task-shinobi_run-02_events.tsv
data/shinobi/sub-02/ses-015/func/sub-02_ses-015_task-shinobi_run-03_events.tsv
=======================================================
sub-02_ses-shinobi_006_20201019-110044_ShinobiIIIReturnOfTheNinjaMaster-Genesis_Level1-0_001
data/shinobi/sub-02/ses-006/func/sub-02_ses-006_task-shinobi_run-02_events.tsv
data/shinobi/sub-02/ses-006/func/sub-02_ses-006_task-shinobi_run-01_events.tsv
=======================================================
sub-02_ses-shinobi_002_20200918-093517_ShinobiIIIReturnOfTheNinjaMaster-Genesis_Level4-1_003
data/shinobi/sub-02/ses-002/func/sub-02_ses-002_task-shinobi_run-04_events.tsv
data/shinobi/sub-02/ses-002/func/sub-02_ses-002_task-shinobi_run-03_events.tsv
=======================================================
sub-06_ses-shinobi_013_20210226-154840_ShinobiIIIReturnOfTheNinjaMaster-Genesis_Level5-0_000
data/shinobi/sub-06/ses-013/func/sub-06_ses-013_task-shinobi_run-04_events.tsv
data/shinobi/sub-06/ses-013/func/sub-06_ses-013_task-shinobi_run-01_events.tsv
=======================================================
sub-01_ses-shinobi_012_20201211-110949_ShinobiIIIReturnOfTheNinjaMaster-Genesis_Level4-1_002
data/shinobi/sub-01/ses-012/func/sub-01_ses-012_task-shinobi_run-02_events.tsv
data/shinobi/sub-01/ses-012/func/sub-01_ses-012_task-shinobi_run-03_events.tsv
=======================================================
sub-01_ses-shinobi_010_20201127-162142_ShinobiIIIReturnOfTheNinjaMaster-Genesis_Level4-1_002
data/shinobi/sub-01/ses-010/func/sub-01_ses-010_task-shinobi_run-02_events.tsv
data/shinobi/sub-01/ses-010/func/sub-01_ses-010_task-shinobi_run-03_events.tsv
=======================================================
sub-01_ses-shinobi_009_20201120-105229_ShinobiIIIReturnOfTheNinjaMaster-Genesis_Level1-0_001
data/shinobi/sub-01/ses-009/func/sub-01_ses-009_task-shinobi_run-01_events.tsv
data/shinobi/sub-01/ses-009/func/sub-01_ses-009_task-shinobi_run-02_events.tsv
=======================================================
sub-01_ses-shinobi_007_20201106-103525_ShinobiIIIReturnOfTheNinjaMaster-Genesis_Level1-0_003
data/shinobi/sub-01/ses-007/func/sub-01_ses-007_task-shinobi_run-03_events.tsv
data/shinobi/sub-01/ses-007/func/sub-01_ses-007_task-shinobi_run-02_events.tsv
=======================================================
sub-01_ses-shinobi_007_20201106-103525_ShinobiIIIReturnOfTheNinjaMaster-Genesis_Level4-1_004
data/shinobi/sub-01/ses-007/func/sub-01_ses-007_task-shinobi_run-04_events.tsv
data/shinobi/sub-01/ses-007/func/sub-01_ses-007_task-shinobi_run-05_events.tsv
hyruuk commented 1 year ago

The identity of the correct bk2 files can be deduced by comparing the duration of the bk2 with the duration indicated in the events.tsv file

bpinsard commented 1 year ago

Yes, the original script detected the overwritten bk2 by using this heuristic, but it needed to have relaxed duration constraint to match the bk2 to the run, it was too relaxed (1s difference) and as participant are really consistent in the way they played the levels, they often completed these in strikingly similar time on successive repeats. The one listed here are examples (at least the one I checked so far) of really close timings between successive repeats. Will correct these ASAP.