vezaynk / Sitemap-Generator-Crawler

PHP script to recursively crawl websites and generate a sitemap. Zero dependencies.
https://www.bbss.dev
MIT License
243 stars 93 forks source link

Canonical URL #47

Open ghost opened 7 years ago

ghost commented 7 years ago

If a page has canonical url set, it should be used in sitemap:

<link rel="canonical" href="https://www.2globalnomads.info" />