search

rom1504 / img2dataset

Easily turn large sets of image urls to an image dataset. Can download, resize and package 100M urls in 20h on one machine.
MIT License
3.71k stars 338 forks source link

MacOS hidden files cause logger process exit #311

Open FlyHighest opened 1 year ago

FlyHighest commented 1 year ago

https://github.com/rom1504/img2dataset/blob/21c297b089cf7bc30480825af83bf1859862f70d/img2dataset/logger.py#L235-L239

Sometimes, there are macos generated system files that start with "._" and end with ".json". int() will throw exception and cause logger exit.

rom1504 commented 1 year ago

@FlyHighest are you still having this issue ? could you PR a fix with a better filtering of files by the logger?