Support for Postgres unlogged tables when copying tables

pydiverse / pydiverse.pipedag

A data pipeline orchestration library for rapid iterative development with automatic cache invalidation allowing users to focus writing their tasks in pandas, polars, sqlalchemy, ibis, and alike.

https://pydiversepipedag.readthedocs.io/

BSD 3-Clause "New" or "Revised" License

15 stars 2 forks source link

Support for Postgres unlogged tables when copying tables #127

Closed nicolasmueller closed 5 months ago

nicolasmueller commented 8 months ago

Currently CopyTable does not yet support Postgres unlogged tables. Support should be added for unlogged tables to be created consistently when the unlogged materialization_detail is set.

windiana42 commented 5 months ago

@nicolasmueller is this issue testable by combining this unlogged test with a cache invalidation test that partially invalidates some tables in a stage? https://gist.github.com/windiana42/aae986b9d0b2c1a4fdde43eab6fc2c49#file-test_postgres-py-L14