brooklyn-data / dbt_artifacts

A dbt package for modelling dbt metadata. https://brooklyn-data.github.io/dbt_artifacts
Apache License 2.0
309 stars 113 forks source link

Adding support for Amazon Athena #408

Open brendan-cook-87 opened 7 months ago

brendan-cook-87 commented 7 months ago

Overview

Adds support Amazon Athena.

Update type - breaking / non-breaking

What does this solve?

Adding Amazon Athena support as per feature request.

Outstanding questions

I am a bit unsure about a few pieces of the dbt_project config. I have added table_type and incrememntal_strategy config conditionally for Athena, but I haven't tested how these affect other databases.

The additional config in the incremental test model is required because by default in Athena if you cast 'apple' to varchar the default response creates a varchar(5) column which doesn't accept a varchar(6) - 'banana', unless you select a table_type that allows for (some) schema evolution (iceberg).

What databases have you tested with?