Allow big seeds - Githubissues

jausanca commented 1 month ago

resolves #446

Description

This pull requests allows to upload seeds with serialized lengths over 68000 characters. It allows so by splitting csv records across chunks which are appended to a session variable on different statement executions.

Checklist

[X] I have signed the CLA
[X] I have run this code in development and it appears to resolve the stated issue
[X] This PR includes tests, or tests are not required/relevant for this PR
[X] I have updated the CHANGELOG.md and added information about my change to the "dbt-glue next" section.

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

moomindani commented 1 month ago

Could you please look failed tasks? e.g. https://github.com/aws-samples/dbt-glue/actions/runs/11068856012/job/30838954297?pr=447

moomindani commented 1 month ago

Thank you for your contribution!

aws-samples / dbt-glue

Allow big seeds #447

Description

Checklist