qubvel / segmentation_models

Segmentation models with pretrained backbones. Keras and TensorFlow Keras.
MIT License
4.73k stars 1.03k forks source link

massive datasets loading and training #583

Open davidvct opened 8 months ago

davidvct commented 8 months ago

if I have a massive datasets of images, and unable to fit all of them into memory, how do I load and train them by batches? my folder structure is:

datasets | |----Train | |---- images | |-----masks | |---- Val |---- images |---- masks