search

rom1504 / laion-prepro

Get hundred of million of image+url from the crawling at home dataset and preprocess them
201 stars 20 forks source link

laion5B scripts #16

Closed rom1504 closed 2 years ago

rom1504 commented 2 years ago

add all scripts used to produce laion5B using img2dataset, clip retrieval and autofaiss