pydiverse / pydiverse.pipedag

A data pipeline orchestration library for rapid iterative development with automatic cache invalidation allowing users to focus writing their tasks in pandas, polars, sqlalchemy, ibis, and alike.
https://pydiversepipedag.readthedocs.io/
BSD 3-Clause "New" or "Revised" License
15 stars 2 forks source link

Add a function to ad-hoc materialize a table for interactive debugging #117

Closed nicolasmueller closed 9 months ago

nicolasmueller commented 9 months ago

Add pipedag.debug.materialize_table, a function to ad-hoc materialize a table from a task for interactive debugging

Checklist

Related issue: #116