fivetran / dbt_hubspot_source

Data models for Hubspot built using dbt.
https://fivetran.github.io/dbt_hubspot_source/
Apache License 2.0
31 stars 30 forks source link

[Bug] Freshness test in `email_event` source table #72

Closed gabriel-inventa closed 2 years ago

gabriel-inventa commented 2 years ago

Is there an existing issue for this?

Describe the issue

The src_hubspot.yml for this package contains a freshness test to one table only email_event. Even if I disable the table in dbt_project.yml the freshness check will be in place when running dbt source freshness. Is this the expected behavior?

Relevant error log or model output

Output

12:30:37  Database Error in source email_event (models/src_hubspot.yml)
12:30:37    002003 (42S02): SQL compilation error:
12:30:37    Object 'RAW.HUBSPOT.EMAIL_EVENT' does not exist or not authorized.

dbt_project.yml variables:

  hubspot_database: raw
  hubspot_schema: hubspot
  hubspot_contact_list_enabled: false
  hubspot_contact_list_member_enabled: false
  hubspot_email_event_enabled: false
  hubspot_email_event_bounce_enabled: false
  hubspot_email_event_deferred_enabled: false
  hubspot_email_event_delivered_enabled: false
  hubspot_email_event_dropped_enabled: false
  hubspot_email_event_forward_enabled: false
  hubspot_email_event_click_enabled: false
  hubspot_email_event_opens_enabled: false
  hubspot_email_event_print_enabled: false
  hubspot_email_event_sent_enabled: false
  hubspot_email_event_spam_report_enabled: false
  hubspot_email_event_status_change_enabled: false
  hubspot_engagement_email_enabled: false
  hubspot_engagement_note_enabled: false
  hubspot_engagement_meeting_enabled: false
  hubspot_engagement_task_enabled: false

Expected behavior

No freshness check in a disabled table.

dbt Project configurations

 hubspot_database: raw
  hubspot_schema: hubspot
  hubspot_contact_list_enabled: false
  hubspot_contact_list_member_enabled: false
  hubspot_email_event_enabled: false
  hubspot_email_event_bounce_enabled: false
  hubspot_email_event_deferred_enabled: false
  hubspot_email_event_delivered_enabled: false
  hubspot_email_event_dropped_enabled: false
  hubspot_email_event_forward_enabled: false
  hubspot_email_event_click_enabled: false
  hubspot_email_event_opens_enabled: false
  hubspot_email_event_print_enabled: false
  hubspot_email_event_sent_enabled: false
  hubspot_email_event_spam_report_enabled: false
  hubspot_email_event_status_change_enabled: false
  hubspot_engagement_email_enabled: false
  hubspot_engagement_note_enabled: false
  hubspot_engagement_meeting_enabled: false
  hubspot_engagement_task_enabled: false

Package versions

packages:
  - package: dbt-labs/dbt_utils
    version: 0.8.5
  - package: tnightengale/dbt_meta_testing
    version: 0.3.5
  - package: calogica/dbt_expectations
    version: 0.5.6
  - package: fivetran/facebook_ads
    version: [">=0.4.0", "<0.5.0"]
  - package: fivetran/hubspot
    version: [">=0.5.0", "<0.6.0"]

What database are you using dbt with?

snowflake

dbt Version

Core:
  - installed: 1.1.1
  - latest:    1.1.1 - Up to date!

Plugins:
  - snowflake: 1.1.0 - Up to date!

Additional Context

No response

Are you willing to open a PR to help address this issue?

fivetran-reneeli commented 2 years ago

Hi @gabriel-inventa! Thanks for raising this issue. We've applied changes to a branch, once it passes testing and PR review we'll go ahead and merge it!