search

elementary-data / elementary

The dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-hosted or cloud service with premium features.
https://www.elementary-data.com/
Apache License 2.0
1.94k stars 165 forks source link

add package-lock needed for dbt 1.8 in read-only deployments #1669

Closed noel closed 1 week ago

noel commented 3 months ago

When elementary is installed on a docker image in a read-only folder, dbt deps are run and that will generate a packages-lock file. The way to solve the packages issue is to include the lock file in the project. This PR will address this issue. The issue here is similar as it is related to running dbt deps in a read-only folder.

With this change, edr commands can be run as follows to address both issues.

               mkdir /tmp/elementary
                export DBT_TARGET_PATH=/tmp/elementary &&
                export DBT_PACKAGES_FOLDER=/tmp/elementary &&
                edr send-report --days-back 60
FrankTub commented 2 months ago

This would be really helpful!

noel commented 1 month ago

Bumping this. Are you planning to make elementary dbt 1.8 compliant?

haritamar commented 1 week ago

Hi @noel ! Just merged these changes in a separate PR (needed to tweak a bit and add a pre-commit verification to the lock), this change will be included in the upcoming release.

Cheers, Itamar