Is your feature request related to a problem? Please describe.
We can configure dbt configurations with environment variables as DBT_DEBUG. Meanwhile, dbt doesn't support such features to vary properties in profiles.yml.
We implement macros to vary properties profiles.yml based on environments. When I tried to use the profiles.yml including the threads property with a macro reference, I got the subsequent error message.
Error message
$ piperider run --select "tag:piperider"
────────────────────────────────────────────────────────────────── Validating ──────────────────────────────────────────────────────────────────
everything is OK.
Error: '>' not supported between instances of 'LiteralScalarString' and 'int'
Example of the threads property with a macro
The custom environment variable called DBT_THREADS enables us to vary the number of threads in a dbt execution. Though I also tried to use the int Jinja2 function, I got the same error.
Is your feature request related to a problem? Please describe.
We can configure dbt configurations with environment variables as
DBT_DEBUG
. Meanwhile, dbt doesn't support such features to vary properties inprofiles.yml
.We implement macros to vary properties
profiles.yml
based on environments. When I tried to use theprofiles.yml
including thethreads
property with a macro reference, I got the subsequent error message.Error message
Example of the
threads
property with a macroThe custom environment variable called
DBT_THREADS
enables us to vary the number of threads in a dbt execution. Though I also tried to use theint
Jinja2 function, I got the same error.https://docs.getdbt.com/reference/dbt-jinja-functions/env_var
Describe the solution you'd like I appriciate if piperider could parse the use case with
profiles.yml
.Describe alternatives you've considered N/A
Additional context N/A