c4software / python-sitemap

Mini website crawler to make sitemap from a website.
GNU General Public License v3.0
362 stars 110 forks source link

Ignore possible errors in UTF-8 encoding #42

Closed ghost closed 6 years ago

ghost commented 6 years ago

All the URLs should be UTF-8 encodable so it is safe to drop the characters with encoding errors. Fix to issue #35.

c4software commented 6 years ago

Thanks for the PR.