search

vezaynk / Sitemap-Generator-Crawler

PHP script to recursively crawl websites and generate a sitemap. Zero dependencies.
https://www.bbss.dev
MIT License
241 stars 92 forks source link

$max_depth is broken #24

Closed vezaynk closed 7 years ago

vezaynk commented 7 years ago

If a page is not scanned due to being nested too deeply, it will be marked as scanned and more shallow attempts to scan it will fail. This is a bug.