mlangguth89 / downscaling_benchmark

6 stars 0 forks source link

Add dataloaders for handling dataset for torch modules #5

Open ankitpatnala opened 6 months ago

ankitpatnala commented 6 months ago

There are two dataloading type defined. -> Use map based dataset (seemed effective for parallelizing) -> Use iterable dataset (seemed effective with single node) (Further can be looked upon to update to multi-node multi-gpu setting)