Disable cache validation for a specific run

pydiverse / pydiverse.pipedag

A data pipeline orchestration library for rapid iterative development with automatic cache invalidation allowing users to focus writing their tasks in pandas, polars, sqlalchemy, ibis, and alike.

https://pydiversepipedag.readthedocs.io/

BSD 3-Clause "New" or "Revised" License

12 stars 2 forks source link

Disable cache validation for a specific run #165

Closed nicolasmueller closed 3 months ago

nicolasmueller commented 3 months ago

It should be possible to force the execution of all tasks when running a flow.

This is useful to invalidate the cache manually, when the user has more up-to-date information than the cache function.