aws-samples / dbt-glue

This repository contains the dbt-glue adapter
Apache License 2.0
101 stars 69 forks source link

Strip unwanted partition columns #422

Closed Jeremynadal33 closed 2 months ago

Jeremynadal33 commented 3 months ago

resolves #421

Description

Modify the function get_columns_in_relation so it does not return unwanted partitions related stuff like "Part 0", "Part 1", ... For more information on this behavior see 421

Checklist

FYI : There are currently a "fake" tests associated with this function. I can update it to add one but I need information on how to mock a BaseRelation object.

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

moomindani commented 2 months ago

Thanks for your contribution.