Closed juraurai closed 5 months ago
Hey @juraurai - Thanks for reaching out. I was able to reproduce using the jaffleshop example, which resulted in the following error trace.
ERROR: launchpadlib 1.10.13 requires testresources, which is not installed.
ERROR: grpcio-health-checking 1.63.0 has requirement protobuf<6.0dev,>=5.26.1, but you'll have protobuf 4.25.3 which is incompatible.
ERROR: dbt-semantic-interfaces 0.4.4 has requirement importlib-metadata~=6.0, but you'll have importlib-metadata 7.1.0 which is incompatible.
ERROR: dbt-core 1.7.14 has requirement urllib3~=1.0, but you'll have urllib3 2.2.1 which is incompatible.
ERROR: dbt-duckdb 1.8.0 has requirement dbt-core>=1.8.0, but you'll have dbt-core 1.7.14 which is incompatible.
I managed to fix this by editing the setup.py
file created by using the Import a dbt project
function import in Dagster+. The setup.py
file is added to the PR created by the process in the GitHub repo.
For the jaffleshop example, forcing dbt-duckdb<1.8
in setup.py
fixed the problem. In your case, doing the same for Snowflake should temporarily fix your problem.
I think the problem comes from the version constraints of dbt-core
which we use for our dagster-dbt
library, see here - this will require a fix on our end.
Thanks for the quick reply! This fixed it indeed.
FYI, I replaced dbt-snowflake with dbt-snowflake<1.8.0
@juraurai Glad to hear it worked! FYI, PR #21904 fixes the problem and should be used in production soon.
Dagster version
1.7.5
What's the issue?
When trying to import a dbt project on github into dagster cloud, I get the following error(s):
What did you expect to happen?
I would have expected to import the dbt project and run have the Serverless Deploy run without errors. I have done this before without these errors a couple of months ago.
How to reproduce?
Create a dbt project on github, with a corresponding profiles.yml. We were using Snowflake as DWH, however I don't think this is correlated. Because the error also happens when creating a new dbt project using the jaffleshop example.
Import the dbt project using the dbt import function in dagster cloud using serverless agent.
Try to deploy the Serverless Agent. In the github actions deployment this error happens in the "prepare DBT project for deployment" step.
Deployment type
None
Deployment details
No custom configurations, just a dbt project on github and dagster cloud.
Additional information
I'm using the 1-month trial
Message from the maintainers
Impacted by this issue? Give it a 👍! We factor engagement into prioritization.