Document crawl updates - Githubissues

18F / FAC-Distiller

Federal Audit Clearing House Distiller

2 stars 4 forks source link

Document crawl updates #125

Closed danielnaab closed 4 years ago

danielnaab commented 4 years ago

Implements issue(s) #124

Changes proposed in this pull request:

Scrapy crawler updates for current site and bugfixes
Target crawls to CFDA prefixes in the database
Crawl all years from 2013-current year