search

workforce-data-initiative / programs-registry

Machine readable, public directory of programs and services offered by eligible training providers
https://docs.brighthive.io
Apache License 2.0
1 stars 0 forks source link

Integrate airflow #23

Closed NdagiStanley closed 6 years ago

NdagiStanley commented 6 years ago

What does this PR do?

This PR updates the Programs Registry API so that the DB is seeded by either CSV/ SQL files. Props to @akebi for diligently preparing the files.

What did I do?

Why did I approach it this way?

Streamlining the seeding process for this DB would inform me better on implementing an Airflow DAG to connect an s3 bucket to the Programs Registry DB. Furthermore, the learnings so acquired would be beneficial for the commit_to_db task in DAG.

NdagiStanley commented 6 years ago

@akebi Take it away. I bet there could be conflicts with your branch so it's best that you be the one to merge this one.