vezaynk / Sitemap-Generator-Crawler

PHP script to recursively crawl websites and generate a sitemap. Zero dependencies.
https://www.bbss.dev
MIT License
241 stars 92 forks source link

<iframe> tags ignored #78

Open kewh opened 5 years ago

kewh commented 5 years ago

The crawler ignores <iframe> tags and their links, which unlike the old <frame> tags are supported by current standards and browsers. Should they be included, or am I missing something?

vezaynk commented 5 years ago

They probably should be, yeah.