search

hellock / icrawler

A multi-thread crawler framework with many builtin image crawlers provided.
http://icrawler.readthedocs.io/en/latest/
MIT License
857 stars 174 forks source link

Proxy pool #3

Closed hellock closed 8 years ago

hellock commented 8 years ago

Integrate the proxy pool with the crawler framework. This new feature is for #1