Bit of a metaissue, partially external to daps_utils:
we need to set up a data-engineering-cookiecutter repo which calls all of the scripts from daps_utils in order to setup a new daps on demand.
Before doing this we will need to work out how to set up the whole infrastructure (metaflow, batch, s3, mysql, other?) using terraform so that we can include that in the script.
Bit of a metaissue, partially external to
daps_utils
:data-engineering-cookiecutter
repo which calls all of the scripts fromdaps_utils
in order to setup a new daps on demand.