some duplicate data was loaded into the raw tables, causing dbt test failures. This PR adds deduplication logic to ensure that our tests pass and then duplicated rows aren't propagated to downstream models.
Checks
[x] All models ran successfully
[x] Changes to models are reflected in the schema.yml
Pick one:
[x] No test failures OR
[ ] No new test failures, and there is a plan in place to address existing ones
Overview
some duplicate data was loaded into the raw tables, causing dbt test failures. This PR adds deduplication logic to ensure that our tests pass and then duplicated rows aren't propagated to downstream models.
Checks