search

datalad-handbook / book

Sources for the DataLad handbook
http://handbook.datalad.org
Other
148 stars 55 forks source link

use the openneuro use case to show case how to paralellize across subdatasets #1202

Closed Remi-Gau closed 11 months ago

Remi-Gau commented 11 months ago

Was chatting with @melanieganz and realized that the openneuro use case could also showcase the 'parallel' subdataset processing to speed up install of the > 1000 datasets that openneuro now has. Otherwise users may be at it until the cows come home. 🐮 🐮 ➡️ 🏠

Originally posted by @Remi-Gau in https://github.com/datalad-handbook/book/issues/1198#issuecomment-1840635351

adswa commented 11 months ago

yes! indeed! (sorry, I saw that comment already, but forgot to reply. I will, after Monday, when the PhD things are done. :) )