Port data loaders to a Cloud Foundry app

18F / fbopen

[DEPRECATED] An open API server, data import tools, and sample apps to help small businesses search for opportunities to work with the U.S. government.

Other

101 stars 45 forks source link

Port data loaders to a Cloud Foundry app #175

Closed arowla closed 8 years ago

arowla commented 9 years ago

The data loaders should probably live as their own CF app, with a heartbeat script to kick off jobs.

[x] Get FBO loader working
[x] Get grants loader working
[x] Get State loader working
[ ] Get attachments loader working (see #183)

Additionally:

[x] Make sure logging is being reported somewhere CF can access it

arowla commented 8 years ago

The SBIR loader is being tabled for now, since there is a completely new site up, and the old scraper is broken.