search

vezaynk / Sitemap-Generator-Crawler

PHP script to recursively crawl websites and generate a sitemap. Zero dependencies.
https://www.bbss.dev
MIT License
243 stars 93 forks source link

Does not work with the following website address... #100

Closed duongkyvuong closed 9 months ago

duongkyvuong commented 9 months ago

Does not work with the following website address: https://satrafoods.com.vn/ err

vezaynk commented 9 months ago

It looks like https://satrafoods.com.vn/vn/vn/vn/vn/.../vn/san-pham are pages that exist in your website (probably by mistake). It's a bug in the website, not this script.