search

pydiverse / pydiverse.pipedag

A data pipeline orchestration library for rapid iterative development with automatic cache invalidation allowing users to focus writing their tasks in pandas, polars, sqlalchemy, ibis, and alike.
https://pydiversepipedag.readthedocs.io/
BSD 3-Clause "New" or "Revised" License
15 stars 2 forks source link

Postgres unlogged tables as a materialization detail #125

Closed nicolasmueller closed 8 months ago

nicolasmueller commented 9 months ago

This PR builds on #122. I moves the Postgres unlogged feature to the materialization details. Also, it refactors some code around the table stores needed for materialization details to reduce code duplication.

Checklist