search

c4software / python-sitemap

Mini website crawler to make sitemap from a website.
GNU General Public License v3.0
362 stars 110 forks source link

Exclude redirects from sitemap #74

Closed Garrett-R closed 3 years ago

Garrett-R commented 3 years ago

It seems redirects are not meant to be in the sitemap (see second commit's message for citations). So this prevents that.

I also tacked on 2 minor cleanups: one for imports and one to use defaultdict, but let me know if you don't want those.

c4software commented 3 years ago

Thanks for the PR. Nice addition and nice spring cleaning ;)

Garrett-R commented 3 years ago

Haha, great glad you liked it!