search

cwerner / fastclass

Little tools to download and then weed through images, delete and classify them into groups for building deep learning image datasets (based on crawler and tkinter)
Apache License 2.0
133 stars 25 forks source link

Remove Baidu from ALL #12

Closed v-raja closed 5 years ago

v-raja commented 5 years ago

Baidu seems to be returning a lot of incorrect file types which cause the program to take time. Also, the -m tag works well when crawling through Google and Bing at the same time, but doesn't work so well when crawling through ALL. I suspect that it might have something to do with Baidu but I'm not sure.

So I think Baidu should be removed from the ALL option and then since the -m tag will work with the all option, we can add it to the readme.

cwerner commented 5 years ago

Hi.

Yeah, Beide is a bit wonky. I think your proposed changes make sense and we should remove it from the ALL option.