Right now, Image DataLoaders partition on the file names (which works well for ImageNet style collections). While it's possible to repartition manually after images have been loaded, the API indicates that passing a Some(numPartitions) will yield an RDD with that many partitions.
Should be a small change to ImageLoaderUtils.getFilePathsRDD or upstream uses of it.
Right now, Image DataLoaders partition on the file names (which works well for ImageNet style collections). While it's possible to repartition manually after images have been loaded, the API indicates that passing a Some(numPartitions) will yield an RDD with that many partitions.
Should be a small change to
ImageLoaderUtils.getFilePathsRDDor upstream uses of it.