search

propublica / upton

A batteries-included framework for easy web-scraping. Just add CSS! (Or do more.)
MIT License
1.62k stars 113 forks source link

make scrape method return an enumerator #38

Open jeremybmerrill opened 9 years ago

jeremybmerrill commented 9 years ago

so we can map over the pages, select just some, etc.

scraper.scrape.select{|contents, url| url.match(whatever)}.each &:whatever