aws-samples / dbt-glue

This repository contains the dbt-glue adapter
Apache License 2.0
96 stars 67 forks source link

Incremental append appears broken with latest version #307

Closed sanga8 closed 8 months ago

sanga8 commented 9 months ago

Describe the bug

The incremental append appears to have been broken with latest changes

Steps To Reproduce

1/ Launch a table with following config

{{ config( materialized='incremental', incremental_strategy='append' ) }} SELECT a, b FROM db.table_source

2/ Add a new line to your table_source, relaunch model. You should have the following error:

insert into table dbt_skeleton_project.glue_incremental_append select from dbt_skeleton_project.glue_incremental_append_tmp ParseException: Syntax error at or near '.'(line 4, pos 37)

Turns out there's no columns after the select. The bug was introduced with 1.7.1, it is working fine in 1.7.0

Adapter version

dbt-glue==1.7.1
moomindani commented 8 months ago

This has been fixed.