dbt-labs / dbt-external-tables

dbt macros to stage external sources
https://hub.getdbt.com/dbt-labs/dbt_external_tables/latest/
Apache License 2.0
286 stars 115 forks source link

External stage refresh gets skipped in snowflake #296

Closed yannik207 closed 2 months ago

yannik207 commented 2 months ago

Describe the bug

I've yesterday created my external stage from gcs to snowflake. The create steps seems to work properly and all the data is ready. Today the data needs a refresh but out of nowhere my external stage gets SKIPPED all the time

Steps to reproduce

`version: 2

sources:

Expected results

I would expect that the data gets refreshed with the new data that landed in the gcs bucket

Actual results

1 of 1 SKIP

Screenshots and log output

dbt run-operation dbt_external_tables.stage_external_sources Running with dbt=1.7.4 Registered adapter: snowflake=1.7.1 Found x models, x tests, 1 operation, x sources, 0 exposures, 0 metrics, x macros, 0 groups, 0 semantic models 1 of 1 START external source external_stages.table 1 of 1 SKIP

System information

The contents of your packages.yml file:

Which database are you using dbt with?

The output of dbt --version:

1.7.4

The operating system you're using:

The output of python --version:

Additional context

3.10.7

yannik207 commented 2 months ago

https://getdbt.slack.com/archives/CJN7XRF1B/p1711403569740349 found this discussion