digitaldutch / roaddanger.org

A website and database for news reports about traffic crashes around the world.
https://www.roaddanger.org/
MIT License
12 stars 3 forks source link

Web crawler to find media web pages #19

Open digitaldutch opened 1 month ago

digitaldutch commented 1 month ago

Currently volunteers find crash articles themselves and add the link to our spider, which loads the page and extracts meta information from this webpage.

A web crawler that crawls media websites or crash aggregation websites (like ongeluk vandaag) . for relevant articles would be quite handy.