mne-tools / mne-bids-pipeline

Automatically process entire electrophysiological datasets using MNE-Python.
https://mne.tools/mne-bids-pipeline/
BSD 3-Clause "New" or "Revised" License
140 stars 67 forks source link

BUG: Fix bug with cache invalidation #756

Closed larsoner closed 1 year ago

larsoner commented 1 year ago

Before merging ā€¦

Closes #748

First run of ds004229 with the default epochs_tmax=1:

[13:04:08] ā”Œā•“šŸš€ preprocessing/_05_make_epochs Now running  šŸ‘‡
[13:04:08] ā”‚ ā³ļø preprocessing/_05_make_epochs sub-102 Loading filtered raw data from sub-102_task-amnoise_proc-filt_raw.fif
[13:04:09] ā”‚ ā³ļø preprocessing/_05_make_epochs sub-102 Creating task-related epochs ā€¦

Next run correctly shows as cached:

[13:09:25] ā”Œā•“šŸš€ preprocessing/_05_make_epochs Now running  šŸ‘‡
[13:09:25] ā”‚ āœ… preprocessing/_05_make_epochs sub-102 Computation unnecessary (cached) ā€¦
[13:09:25] ā””ā•“šŸŽ‰ preprocessing/_05_make_epochs Done running  šŸ‘† [1s]

Change tmax to 2 it correctly re-runs:

[13:17:08] ā”Œā•“šŸš€ preprocessing/_05_make_epochs Now running  šŸ‘‡
[13:17:08] ā”‚ ā³ļø preprocessing/_05_make_epochs sub-102 Loading filtered raw data from sub-102_task-amnoise_proc-filt_raw.fif
[13:17:09] ā”‚ ā³ļø preprocessing/_05_make_epochs sub-102 Creating task-related epochs ā€¦

On this PR, changing back to 1 correctly re-runs:

[13:18:29] ā”Œā•“šŸš€ preprocessing/_05_make_epochs Now running  šŸ‘‡
[13:18:29] ā”‚ šŸ”‚ preprocessing/_05_make_epochs sub-102 Output file hash mismatch, will recompute ā€¦
[13:18:29] ā”‚ ā³ļø preprocessing/_05_make_epochs sub-102 Loading filtered raw data from sub-102_task-amnoise_proc-filt_raw.fif
[13:18:30] ā”‚ ā³ļø preprocessing/_05_make_epochs sub-102 Creating task-related epochs ā€¦