elementary-data / elementary

The dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-hosted or cloud service with premium features.
https://www.elementary-data.com/
Apache License 2.0
1.85k stars 153 forks source link

[ELE-291] Group and filter tests by tags #369

Open joostboon opened 1 year ago

joostboon commented 1 year ago

We would love to group our tests based on tags. We have different dimensions (accuracy/completeness/uniqueness/etc.). Now we can see the model tags, but not the test tags.

Visually it would be great if we could see the different test tags in the UI. Ideally as a next step we would love to group/sort by tags.

ELE-55

RoiTabach commented 1 year ago

oh no

RoiTabach commented 1 year ago

Sorry, unlinked

TwBridges commented 1 year ago

I also have a use case where I need to be able to send slack alerts for custom tests as over half of our testing for our data mart are custom tests that include business logic and it would be nice to alert if our business logic is failing.

evelinasamuelsson commented 1 year ago

I have the same use case as @joostboon! Would be great if we could use this to group test based on tags

Maayan-s commented 1 year ago

https://elementary-community.slack.com/archives/C02CTC89LAX/p1678964139198919

cooley-hi commented 1 year ago

@Maayan-s Does that solve this problem. I have my test tagged like this:

models:
  - name: some name
    tests:
      - some-test:
          tags: "some-tag"

dbt recognizes this tag but it doesn't show up in the elementary ui. We use this tag for tests that we want to include but haven't been fully vetted so it can make our dashboard pretty noisy.

Maayan-s commented 1 year ago

Hi @cooley-hi , the issue here is just what you described - dbt supports adding tags to tests, but Elementary currently ignores these tags and only uses models tags. We want to change that :)

cooley-hi commented 1 year ago

💯

On Sun, Apr 23, 2023 at 2:21 PM Maayan Salom @.***> wrote:

Hi @cooley-hi https://github.com/cooley-hi , the issue here is just what you described - dbt supports adding tags to tests, but Elementary currently ignores these tags and only uses models tags. We want to change that :)

— Reply to this email directly, view it on GitHub https://github.com/elementary-data/elementary/issues/369#issuecomment-1519171222, or unsubscribe https://github.com/notifications/unsubscribe-auth/AZQ6OJ4LGVKN3JAQHJ3R5ZLXCWMORANCNFSM6AAAAAARRBO2UE . You are receiving this because you were mentioned.Message ID: @.***>

--

Matt Cooley

Data Engineer

877 475 0179

Join our team https://bit.ly/3kMVeWv

Human Interest Inc. (“Human Interest http://www.humaninterest.com") is a 401(k) provider that gives small and medium-sized businesses access to low-cost, high-quality retirement plans that make it easy to start saving for your future. Human Interest's investment advisory services are provided for a fee by Human Interest Advisors, LLC ("HIA"), a subsidiary of Human Interest. See full disclosures https://humaninterest.com/disclosures.

Geuchies commented 11 months ago

I'm also running into this issue, I'm trying to filter based on business cases, and not every data quality requirement from the source or model applies to the business cases.