pydiverse / pydiverse.pipedag

A data pipeline orchestration library for rapid iterative development with automatic cache invalidation allowing users to focus writing their tasks in pandas, polars, sqlalchemy, ibis, and alike.

https://pydiversepipedag.readthedocs.io/

BSD 3-Clause "New" or "Revised" License

12 stars 2 forks source link

Implement @input_stage_version decorator which provides inputs from two versions of the same stage before schema swapping #188

Closed windiana42 closed 2 months ago

windiana42 commented 2 months ago

Checklist

[x] Added a docs/source/changelog.md entry
[x] Added/updated documentation in docs/source/
[x] Added/updated examples in docs/source/examples.md