This PR will address the following Issue/Feature: No corresponding issue or feature
This PR will result in the following new package version:v1.6.0
Please provide the finalized CHANGELOG entry which details the relevant changes included in this PR:
Bug Fixes
It was observed that the fivetran_platform__audit_table model could potentially introduce duplicates for database like connectors. To address this issue, the join logic in the end model was adjusted to no longer be determined by date ranges and instead be defined via model generated indexes. This ensures true uniqueness in the end model.
Testing Updates
Addition of the tests/ folder which includes various custom validation tests to ensure the the output of the end models are matching our expectations.
These tests are disabled by default as they are not necessary to run after every execution of the models. If you would like to enabled these tests you may activate them by defining the fivetran_validation_tests_enabled variable as true.
PR Checklist
Basic Validation
Please acknowledge that you have successfully performed the following commands locally:
[ ] dbt run –full-refresh && dbt test
[ ] dbt run (if incremental models are present) && dbt test
Before marking this PR as "ready for review" the following have been applied:
[ ] The appropriate issue has been linked, tagged, and properly assigned
[ ] All necessary documentation and version upgrades have been applied
[ ] docs were regenerated (unless this PR does not include any code or yml updates)
[ ] BuildKite integration tests are passing
[ ] Detailed validation steps have been provided below
Detailed Validation
Please share any and all of your validation steps:
If you had to summarize this PR in an emoji, which would it be?
PR Overview
This PR will address the following Issue/Feature: No corresponding issue or feature
This PR will result in the following new package version:
v1.6.0
Please provide the finalized CHANGELOG entry which details the relevant changes included in this PR:
Bug Fixes
fivetran_platform__audit_table
model could potentially introduce duplicates for database like connectors. To address this issue, the join logic in the end model was adjusted to no longer be determined by date ranges and instead be defined via model generated indexes. This ensures true uniqueness in the end model.Testing Updates
tests/
folder which includes various custom validation tests to ensure the the output of the end models are matching our expectations.fivetran_validation_tests_enabled
variable astrue
.PR Checklist
Basic Validation
Please acknowledge that you have successfully performed the following commands locally:
Before marking this PR as "ready for review" the following have been applied:
Detailed Validation
Please share any and all of your validation steps:
If you had to summarize this PR in an emoji, which would it be?
🖥️