indrajithi / tiny-web-crawler

A simple and easy to use web crawler for Python
MIT License
55 stars 11 forks source link

add support for concurrent workers, custom delay and optional verbose #7

Closed indrajithi closed 2 weeks ago