search

elementary-data / elementary

The dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-hosted or cloud service with premium features.
https://www.elementary-data.com/
Apache License 2.0
1.86k stars 158 forks source link

dbt manifest table in elementary #1258

Open natarajanc-prodigygame opened 10 months ago

natarajanc-prodigygame commented 10 months ago

Is your feature request related to a problem? Please describe. A clear and concise description of what the problem is. Ex. I'm always frustrated when [...] i would like to inspect model configs in elementary tables - right now there is no way to see model configurations in elementary

Describe the solution you'd like A clear and concise description of what you want to happen. Have dbt_manifest data in elementary table

Describe alternatives you've considered A clear and concise description of any alternative solutions or features you've considered. loading manifest using python package dbt-artifact-parser

Additional context Add any other context or screenshots about the feature request here.

Would you be willing to contribute this feature? Let us know if you're willing to contribute so that we'll be able to provide guidance.

haritamar commented 3 months ago

Hi @natarajanc-prodigygame ! Thanks for opening this issue and sorry for the long delay. Not sure if the issue is still relevant.

Would you mind clarifying exactly what you mean? Elementary has multiple models that represent data contained in the manifest - in particular the dbt_models table contains full information about all the models and their configuration.

So would love to understand exactly what is missing.