pydiverse / pydiverse.pipedag

A data pipeline orchestration library for rapid iterative development with automatic cache invalidation allowing users to focus writing their tasks in pandas, polars, sqlalchemy, ibis, and alike.
https://pydiversepipedag.readthedocs.io/
BSD 3-Clause "New" or "Revised" License
15 stars 2 forks source link

Implemented ExternalTableReference at flow wiring time. #211

Closed windiana42 closed 1 month ago

windiana42 commented 1 month ago

It was actually accidentally discovered that this produced nasty error messages (crash at item.stage.id due to item.stage=None). Supporting it was as easy as producing good error messages.

Checklist