Open marks opened 10 years ago
Not only is it absolutely within the near-term realm of possibility, but in fact, making FBOpen a centralized query-able source of federal, state, and local opportunities is something we've been planning to do from the very beginning. The DOBT folks know this of course and we're thrilled they've already made so much progress on state/local in parallel with our federal work.
DOBT's scrapers don't appear to crawl for attachments like ours do (yet?), but even without attachments, loading those opportunities into FBOpen would be a great value-add. And I'll bet there's stuff we can learn from their work and vice-versa. Thankfully we're both working in node.js. :-)
Cc @adamjacobbecker
@aaronsnow many of the @dobtco/openrfps-scrapers do include arrays for attachment/downloadable files which could be scraped and imported into solr down the line.
Is this within the near-term realm of possibility for this project by @18F or is it better suited for a fork? What I am thinking is a place to query not just federal opps and grants but also local, state, etc. ones.
See https://github.com/dobtco/openrfps-scrapers/wiki/List-of-Procurement-Websites#scrapers-in-progress for a list of scrapers ("loaders") in progress/completed.