Website crawler through sitemap.xml

wuwanahq / wuwana2

🇪🇺 Wuwana v2 - A webapp to help users find local suppliers in Spain.

Mozilla Public License 2.0

2 stars 2 forks source link

Open levogirar opened 3 years ago

levogirar commented 3 years ago

Improve the website crawler by scraping all the pages of the website using the links found on the sitemap.xml.