sparkgeo / hackathon-mermaid-etl

0 stars 0 forks source link

ETL02 managing schema migrations in make start_db #4

Closed captaincoordinates closed 4 years ago

captaincoordinates commented 4 years ago

Create / upgrade SQL schema on start of a new ETL container using Alembic. Ultimately ETL container will manage ETL work and access Postgres via its SQLAlchemy models. make start_db will now run until schema migration is complete, by tailing 'migration monitor' logs, and remove the need for sleep 10 in original Makefile. Pgadmin is provided for simpler Postgres access.

If you are generally happy with the approach I will add the new table definitions.