search

SpikeInterface / MEArec

Fast and customizable of extracellular recordings on MEA
GNU General Public License v3.0
42 stars 19 forks source link

Load templates as memmap rather than in memory #167

Closed DradeAW closed 7 months ago

DradeAW commented 8 months ago

When generating very big dataset, it's very easy to have templates bigger than 60 GiB

This PR makes the templates be loaded as memmaps rather than in memory .

DradeAW commented 8 months ago

Ok I can confirm that generating the templates now works while using a lot less RAM

Tomorrow I'll check whether there is a conversion to memory while generating the recording

DradeAW commented 8 months ago

I need to test this last commit, @alejoe91 Do you think they're good or should I also change something else?

alejoe91 commented 8 months ago

Looks good to me! Let me know when I should merge