search

mne-tools / mne-bids-pipeline

Automatically process entire electrophysiological datasets using MNE-Python.
https://mne.tools/mne-bids-pipeline/
BSD 3-Clause "New" or "Revised" License
140 stars 67 forks source link

using caching for get_runs_all_subjects to speed up get_runs #716

Closed agramfort closed 1 year ago

agramfort commented 1 year ago

closes #715

@apmellot can you see if it fixes your problem?

apmellot commented 1 year ago

@agramfort Yes it fixes my problem!

hoechenberger commented 1 year ago

I didn't really take the time to look, but I expected the pkg_resources issue to be solved already upstream via https://github.com/mne-tools/mne-python/pull/11454 -- maybe some bits were forgotten there?

larsoner commented 1 year ago

@hoechenberger downloading eeg_matchingpennies is currently at ~40 minutes and will probably time out soon. It's a ~350 MB dataset for subject 05 (the one we use) -- I'm going to just make an osf.io mirror of the dataset I think...

agramfort commented 1 year ago

I just restarted the CI

Message ID: @.***>

larsoner commented 1 year ago

I just restarted the CI

I've effectively done that a couple of times, and it didn't help. I am downloading the dataset now and it has been over 20 minutes and it's not done locally. We need to migrate I think

agramfort commented 1 year ago

sounds good!

Message ID: @.***>

hoechenberger commented 1 year ago

I'm going to just make an osf.io mirror of the dataset I think...

Go for it :)