search

vezaynk / Sitemap-Generator-Crawler

PHP script to recursively crawl websites and generate a sitemap. Zero dependencies.
https://www.bbss.dev
MIT License
243 stars 93 forks source link

How to setup page I need ? #101

Closed nethiker76 closed 3 months ago

nethiker76 commented 3 months ago

Scanning large websites takes a lot of time, and if it is interrupted, there will be no data (sitemap.xml). How to setup page I need ? thank you!

vezaynk commented 3 months ago

If it gets interrupted, you can recover it from a temp file: https://github.com/vezaynk/Sitemap-Generator-Crawler/blob/358b6cc32e2ba5297df35d2c4079b2351fbf8797/sitemap.php#L81