c4software / python-sitemap

Mini website crawler to make sitemap from a website.
GNU General Public License v3.0
362 stars 110 forks source link

Crawl fails to find one page #36

Open ghost opened 7 years ago

ghost commented 7 years ago

Command: python3 ~/sitemap/python-sitemap-master/main.py --domain https://www.2globalnomads.info --image --output sitemap.xml --report Missing page:

https://www.2globalnomads.info/suomi-fi/