BUG - stg_ad_history failing uniqueness tests

[fivetran-jamie]

Are you a current Fivetran customer?

fivetran made issue (but this from veronica beard)

Describe the bug

Uniqueness test is failing on the staging ad_history table. in the customer's raw table ad_history table, ad id|| modified_time are indeed unique, so I am thinking that the joins with ad_group and/or campaign are causing fanout

Steps to reproduce

1. Go to '...'
2. Click on '....'
3. Scroll down to '....'
4. See error

Expected behavior

the test should pass!

Project variables configuration

copy dbt_project.yml here

Package Version

copy packages.yml here

Warehouse

- [x] BigQuery - [ ] Redshift - [ ] Snowflake - [ ] Postgres - [ ] Databricks - [ ] Other (provide details below) **Additional context** **Screenshots**

Please indicate the level of urgency

Are you interested in contributing to this package?

• [ ] Yes, I can do this and open a PR for your review.
• [ ] Possibly, but I'm not quite sure how to do this. I'd be happy to do a live coding session with someone to get this fixed.
• [ ] No, I'd prefer if someone else fixed this. I don't have the time and/or don't know what the root cause of the problem is.

[MaximeLagresle]

Hi,

Sharing our dbt_project.yml configs for that specific package:

vars:

    microsoft_ads_schema: bingads
    microsoft_ads_database: fivetran-data-culture-big-vv9p

    microsoft_ads_source:
      microsoft_auto_tagging_enabled: true  

models:

  microsoft_ads_source:
    +schema: staging
    +materialized: view

  microsoft_ads:
    +schema: marketing  # leave blank for just the target_schema

[fivetran-jamie]

thanks @MaximeLagresle ! so i think i may have found the culprit here. could you try out my working branch and see if the uniqueness test is still failing?

# packages.yml
packages:
  - git: https://github.com/fivetran/dbt_microsoft_ads_source.git
    revision: bug/ad-history-uniqueness

[MaximeLagresle]

Hey Jamie,

Thanks so much for quickly looking into that!

Unfortunately, I still have the error…

Here’s what I did:

• Remove the two packages:
  • microsoft_ads
  • microsoft_ads_source
• Added your package attached in your email
• Run dbt deps
• Run dbt test

Let me know if I should do anything else!

[fivetran-jamie]

ah i think you need to dbt run in between the dbt deps and dbt test -- could you try that?

[MaximeLagresle]

@fivetran-jamie my bad, you're right it works now!

[fivetran-jamie]

great! this is merged and released

[MaximeLagresle]

great! thanks @fivetran-jamie !