I experimented with migrating the Athena scripts to the DBT database transformation tool... and it was wildly successful, so much that I can now run the ELT in under 10 minutes (using parallelism) and even killed off the old remaining Postgres-in-Docker tables I had.
I experimented with migrating the Athena scripts to the DBT database transformation tool... and it was wildly successful, so much that I can now run the ELT in under 10 minutes (using parallelism) and even killed off the old remaining Postgres-in-Docker tables I had.