Open adrianbr opened 1 year ago
@adrianbr I recommend using v2 of the dbt Cloud admin API, as it's more standard for this type of integration.
Assuming the user has already defined a job, possibly with steps like dbt build --select source:my_source_loaded_via_dlt+
— they would then need to provide your integration with:
After kicking off, you can either poll for job status, or get a webhook on completion: https://docs.getdbt.com/docs/deploy/webhooks
Check out a similar example in the documentation, for triggering a dbt Cloud job via GHA:
@jtcohen6 thx for the hint, this looks way easier than running dbt locally (no need to install deps, refresh the project, run commands etc.)
there are a few things on top of running jobs that I'd like to try:
credentials_id
in the Environment (https://docs.getdbt.com/dbt-cloud/api-v2#/operations/Retrieve%20Environment) but I cannot find more info. then our users could setup them once.I'll OFC dig deeper into the API but maybe you just know the answers :)
We want to equally support dbt core and cloud. To offer cloud support, we need to create some kind of operator for this api
https://docs.getdbt.com/dbt-cloud/api-v3#/
The operator should have the following options: