fivetran / dbt_fivetran_log

Data models for Fivetran's internal log connector built using dbt.
https://fivetran.github.io/dbt_fivetran_log/
Apache License 2.0
30 stars 24 forks source link

[Bug] `stg_fivetran_log__log` sometimes failing unique test #71

Closed fivetran-catfritz closed 1 year ago

fivetran-catfritz commented 1 year ago

Is there an existing issue for this?

Describe the issue

In stg_fivetran_log__log, the combination of columns log_id and created_at may not provide unique records as there are multiple event_subtypes and message_data records for those logs. As a result this table may fail a uniqueness test. Possibly batch updates in the connector.

Relevant error log or model output

See Catherine for screenshots/longer history as these are related to our data.

Expected behavior

Test passes.

dbt Project configurations

fivetran_log_using_triggers: false

Package versions

packages:

What database are you using dbt with?

bigquery

dbt Version

1.3

Additional Context

No response

Are you willing to open a PR to help address this issue?

fivetran-catfritz commented 1 year ago

This is a duplicate of #34. Closing issue.