ContentMine / journal-scrapers

Journal scraper definitions for the ContentMine framework
66 stars 33 forks source link

Create auto-test system using quickscrape #4

Closed blahah closed 10 years ago

blahah commented 10 years ago

When scrapers are contributed, they should come with a list of URLs and the expected extractions. Travis should then test each scraper by running quickscrape on a random subset of the provided URLs and ensuring the extracted data matches the expectation.