Record which runs are getting killed because they're running too long in the database

openaustralia / morph

Take the hassle out of web scraping

https://morph.io

GNU Affero General Public License v3.0

461 stars 74 forks source link

Open mlandauer opened 8 years ago

mlandauer commented 8 years ago

And use this to switch off automated runs for scrapers that are consistently running over time. Of course email the people involved so that they know

henare commented 8 years ago

Great idea!