search

aws-samples / dbt-glue

This repository contains de dbt-glue adapter
Apache License 2.0
91 stars 59 forks source link

Delta merge fails with multiple partition key #345

Closed satyam-k-m closed 1 month ago

satyam-k-m commented 4 months ago

Describe the bug

A clear and concise description of what the bug is. What command did you run? What happened?

Delta Merge fails when using multiple partition keys while considering the list of columns as a string of columns. Below is the screenshot for the error: image

Steps To Reproduce

Just by adding file_format as delta and using multiple partition key. image

Expected behavior

It works well with parquet table and it should generate write command as follows: image

moomindani commented 1 month ago

This has been fixed in https://github.com/aws-samples/dbt-glue/pull/346