Open ecnmst opened 7 years ago
Hey, Web Monitoring seems to share a lot of the goals we have, and face the same issues. They also have a nice thread where they listed existing projects/packages that can be used some of the issues we face: https://github.com/edgi-govdata-archiving/web-monitoring/issues/18
It's probably worth a look, and we should probably talk to them as well!
Here there's a project for web monitoring written in Python that gives some good ideas about system notifications and maybe it can inspire us for our bot: https://github.com/thp/urlwatch
That might be interesting as well: https://github.com/ikreymer/pywb
pywb allows high-quality replay (browsing) of archived web data stored in standardized ARC and WARC, and it can also serve as a customizable rewriting proxy to live web content.
Project with a lot of tools for Web Scraping in Python (And other languages). I think it's very useful and can help us to solve some problems that might occur: https://github.com/lorien/awesome-web-scraping/blob/master/python.md
The idea is to collect in the same place projects we have related interests with, so that we reach out to collaborate. The following projects for instance are related: