search

paulhager / MMCL-Tabular-Imaging

82 stars 13 forks source link

DVM Dataset Processing Out of Memory Issue #14

Closed lyrain2001 closed 6 months ago

lyrain2001 commented 6 months ago

Hi,

Firstly, I'd like to express my admiration for the impressive work.

I encountered an Out Of Memory issue when running create_dvm_dataset.ipynb, particularly at the image normalization and saving step. To align my setup with yours and ensure a smooth run, could you please share the GPU memory specifications and any batch size or optimization strategies used in your environment?

Thanks in advance for your time.

paulhager commented 6 months ago

Image normalization should not be running on GPU, so GPU memory is not relevant. This is running on your CPU and using RAM. If you run out of RAM while preprocessing I recommend either saving the dataset in smaller increments or using live loading during training which means you can skip the preprocessing step entirely.

lyrain2001 commented 6 months ago

My problem has been solved. Thanks for your help!