A data pipeline orchestration library for rapid iterative development with automatic cache invalidation allowing users to focus writing their tasks in pandas, polars, sqlalchemy, ibis, and alike.
After #140 Polars and Pandas DataFrames that come out of lazy tasks are always cache-invalid (since they don't have a query string and no version). We should check their cache validity by hashing the data. This should be implemented in the lazy_query_str function of the respective table hooks.
After #140 Polars and Pandas
DataFramesthat come out of lazy tasks are always cache-invalid (since they don't have a query string and no version). We should check their cache validity by hashing the data. This should be implemented in thelazy_query_strfunction of the respective table hooks.