HASTE-project / microscope-simulator

Simulate a high-content imaging experiment
0 stars 0 forks source link

Pre-caching approach means simulator runs out of RAM for full Dataset #12

Closed benblamey closed 6 years ago

benblamey commented 6 years ago

binning functionality requires this - do we need that functionality? if the real microscope doesn't do this, lets remove it so that we don't have to pre-cache the files.

(this step takes 5+ mins for the full dataset, and uses ~105GB of RAM)

The issue is that the pre-processing is too slow otherwise to stream at max-speed