add end time to scraps table`

thequbit / BarkingOwl

scalable web scraper framework for finding documents on websites.

GNU General Public License v3.0

19 stars 7 forks source link

Closed thequbit closed 10 years ago

thequbit commented 11 years ago

It would be nice to see how long websites are taking to scrape. We should be collecting both start and end times for scraping runs.

thequbit commented 10 years ago

No longer relevant post re-write.