Easily turn large sets of image urls to an image dataset. Can download, resize and package 100M urls in 20h on one machine.
3.71k
stars
338
forks
source link
pyarrow.lib.ArrowInvalid: CSV parse error: Expected 1 columns, got 2: https://rmrbcmsonline.peopleapp.com/upload/ueditor/image/20200914/a_490014455258673152.jpg?x-oss ... #431
Open
lucasjinreal opened 4 months ago
Consider hanlde img_url.txt might contains urls with space?