c4software / python-sitemap

Mini website crawler to make sitemap from a website.
GNU General Public License v3.0
362 stars 110 forks source link

gpl #17

Closed etw3gh closed 7 years ago

etw3gh commented 7 years ago

We'd like to add the gpl3.0 license to this repository

I've used your code to generate a sitemap for www.epa.gov and will be moving forward with it for every gov't website. The purpose is to have sitemaps that people can use to archive data prior to ideological purges expected during the Trump administration.

https://github.com/guerrilla-archiving

https://github.com/guerrilla-archiving/python-sitemap

https://ischool.utoronto.ca/content/guerrilla-archiving-event-saving-environmental-data-trump

c4software commented 7 years ago

Nice idea ! Great to see my tool used for that kind of actions !