search

aws-samples / dbt-glue

This repository contains the dbt-glue adapter
Apache License 2.0
101 stars 69 forks source link

Use profile database for temp table during incremental logic #373

Open sivasankarig opened 7 months ago

sivasankarig commented 7 months ago

Describe the bug

  Glue adapter is using default database to create temp table during incremental logic which cause job fail as user/role doe snot have access to default database

Steps To Reproduce

  1. Remove access to default database

  2. Run incremental table (iceberg)

    https://aws.amazon.com/blogs/big-data/build-and-manage-your-modern-data-stack-using-dbt-and-aws-glue-through-dbt-glue-the-new-trusted-dbt-adapter/

Expected behavior

It should use schema from profile configuration.

Screenshots and log output

Access denied to default database.