c4software / python-sitemap

Mini website crawler to make sitemap from a website.
GNU General Public License v3.0
362 stars 110 forks source link

fix(crawler): add condition for not parseable content #77

Closed ChenKuanSun closed 2 years ago

ChenKuanSun commented 3 years ago

Add condition for not parseable content.