There is currently a docker-compose file in dbt-spark. It's finicky and doesn't always work. If it did work, local development would be a lot easier.
Acceptance Criteria
[ ] A Docker container we can reliably spin up to test locally before pushing changes up
[ ] A make command to set everything up (See make setup-db in dbt-core)
[ ] Documentation in the repo on how to run the container for local development
Details
dbt-core uses a local docker container to run postgres. This could possibly work similarly. Update the Makefile appropriately to reflect it if the docker container can be fixed.
Some report that if you just restart the container a few times it will start working. But all the integration tests don't run, it fails out early.
High Level Task
There is currently a
docker-composefile indbt-spark. It's finicky and doesn't always work. If it did work, local development would be a lot easier.Acceptance Criteria
make setup-dbindbt-core)Details
dbt-coreuses a local docker container to run postgres. This could possibly work similarly. Update the Makefile appropriately to reflect it if the docker container can be fixed.Some report that if you just restart the container a few times it will start working. But all the integration tests don't run, it fails out early.
Unknowns
Why doesn't it work?
Additional Notes
Relates to: #386