search

brooklyn-data / dbt_artifacts

A dbt package for modelling dbt metadata. https://brooklyn-data.github.io/dbt_artifacts
Apache License 2.0
309 stars 113 forks source link

[Bug]: Error creating sql incremental model dbt_artifacts.invocations #409

Open fatemehramezani opened 7 months ago

fatemehramezani commented 7 months ago

Overview

I found out it is possible to use run artifacts to get the used tables in source yaml file. But I got an error in creating the model.

How to reproduce

I want to get the list of used tables which are defined in _stg_sources.yml file. Therefore, I call the job like this:

dbt run --select dbt_artifacts

which is defined like this in dbt_project.yaml:

 dbt_artifacts:
    +enabled: false
    sources:
      +enabled: true
      +schema: "artifacts"

It says create just sources and ignore the rest but it fails because of image

All catalogs/schema in Databricks should be dropped and let dbt_artifacts to create its schema which out dependency to any other schema/catalog.

Expected behaviour

It should just build sources model and not the other models like dbt_artifacts.invocations or dbt_artifacts.seeds If not then it should not fail because of dbt_artifacts.invocations

Screenshots

image

Environment

Results of running dbt --version:

# Add the results here
# dbt Cloud

Please paste the contents of your packages.yml file here:

packages:
  - package: brooklyn-data/dbt_artifacts
    version: 2.6.1