aws-samples / dbt-glue

This repository contains the dbt-glue adapter
Apache License 2.0
96 stars 67 forks source link

Re-submit #297 to enable users to fix their glue_session_id name and re-use it #322

Closed moomindani closed 8 months ago

moomindani commented 8 months ago

In # 319, We needed to revert multiple PRs including https://github.com/aws-samples/dbt-glue/pull/297. This PR is to re-submit PR 297 to add minimal model contract enforcement for glue adapter.

Description

This PR adds limited dbt model contract enforcement for the glue adapter. It adds a call to the get_assert_columns_equivalent() macro which is used to enforce the schemas for view and table materializations.

I say "limited" because it's missing a portion of the enforcements which includes but not limited to constraints and potential various Glue specific datatypes. In this PR, I only addressed the string type.

Checklist

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.