search

vezaynk / Sitemap-Generator-Crawler

PHP script to recursively crawl websites and generate a sitemap. Zero dependencies.
https://www.bbss.dev
MIT License
243 stars 93 forks source link

Adds only the main page :( #71

Closed webapteka closed 6 years ago

webapteka commented 6 years ago

Hello!

Sait https://www.indiamed.biz

Adds only the 1 main page :(

What could be the problem? What am I doing?

vezaynk commented 6 years ago

All your links start with // instead of https://. While this isn't incorrect per the web specification AFAIK, I don't see why you would do such a thing as I'm pretty certain that my parser isn't the only thing that it's breaking.