fivetran / dbt_shopify_source

Fivetran's Shopify source dbt package
https://fivetran.github.io/dbt_shopify_source/
Apache License 2.0
29 stars 23 forks source link

Feature/performance updates #79

Closed fivetran-catfritz closed 4 months ago

fivetran-catfritz commented 5 months ago

PR Overview

This PR will address the following Issue/Feature:

This PR will result in the following new package version:

Please provide the finalized CHANGELOG entry which details the relevant changes included in this PR:

🚨 Breaking Changes 🚨

  • To reduce storage, updated default materialization of staging models to views.
    • Note that stg_shopify__metafield will still be materialized as a table for downstream use.

      ⚠️ Running a --full-refresh will be required if you have previously run these staging models as tables and get the following error:

      Trying to create view <model path> but it currently exists as a table. Either drop <model path> manually, or run dbt with `--full-refresh` and dbt will drop it for you.

      Under the Hood

  • Updated the maintainer PR template to the current format.
  • Added integration testing pipeline for Databricks SQL Warehouse.

PR Checklist

Basic Validation

Please acknowledge that you have successfully performed the following commands locally:

Before marking this PR as "ready for review" the following have been applied:

Detailed Validation

Please share any and all of your validation steps:

If you had to summarize this PR in an emoji, which would it be?

:dancer:
fivetran-catfritz commented 5 months ago

@fivetran-joemarkiewicz This is ready for re-review!