search

fal-ai / dbt-fal

do more with dbt. dbt-fal helps you run Python alongside dbt, so you can send Slack alerts, detect anomalies and build machine learning models.
https://fal.ai/dbt-fal
Apache License 2.0
851 stars 71 forks source link

chore: dbt v1.4 support for fal cli #727

Closed chamini2 closed 1 year ago

chamini2 commented 1 year ago

Notes

  1. Python 3_11 cannot be supported until a new version of dill is published.
  2. dbt<1.4 support had to be dropped because of adapter-specific dependencies
    • google-cloud-bigquery==3.5.0 is necessary for 1.4 but not compatible with dbt-bigquery<1.4
    • snowflake-connector-python had similar issues
    • Added a dbt-core dependency explicitly about it
    • Left version-sensitive code in case we get requests and have to figure out a way to support more versions
      • Probably could make it work for non-bigquery adapters
  3. We really need to get the integration tests in order

Adapters to test postgres, bigquery, snowflake, redshift, duckdb, athena, fal

Python versions 3.7, 3.10

linear[bot] commented 1 year ago

FEA-807 dbt 1.4 support

chamini2 commented 1 year ago

got integration tests to pass, reviewing pytest now!

chamini2 commented 1 year ago

The errors are becuase of isolate cloud changes. We can address them in a separate PR.