search

indrajithi / tiny-web-crawler

A simple and easy to use web crawler for Python
MIT License
55 stars 11 forks source link

Crawl depth per domain #37

Open indrajithi opened 1 week ago

indrajithi commented 1 week ago