rom1504 / img2dataset

Easily turn large sets of image urls to an image dataset. Can download, resize and package 100M urls in 20h on one machine.
MIT License
3.62k stars 336 forks source link

[DRAFT] feat: allow fixed resize #427

Open borisdayma opened 4 months ago

borisdayma commented 4 months ago

This would allow resizing to fixed size for example 256x256.

The interest is when training on large datasets (CLIP models for example), if we only need a certain size then we may as well directly download to that target and limit storage requirements.