search

dataform-co / dataform-web-tracking

Dataform is a collaborative data modelling platform that enables analysts and engineers to manage complex data models in SQL
https://dataform.co
MIT License
2 stars 0 forks source link

Separate run environment for develop and master branches. #305

Closed ghost closed 3 years ago

ghost commented 3 years ago

At our organization we have separate development and production GCP projects. Dataform would work better if I could set the default project and dataset for master and develop branches. I am aware of the "configOverride" in the environments.json file as shown here, but that only covers the scheduler and not the manual runs I can do by clicking on "Start New Run".

BenBirt commented 3 years ago

In this case I'd propose configuring the defaults in dataform.json to be your development environment. Production runs will happen from the overrides as specified in environments.json.