A data pipeline orchestration library for rapid iterative development with automatic cache invalidation allowing users to focus writing their tasks in pandas, polars, sqlalchemy, ibis, and alike.
pipedag is developed using poetry. However, in projects, we mostly use conda. So it would be nice to build a conda package as part of the CI and to test it with a little test bench that runs for a combination of multiple pandas and sqlalchemy versions.
pipedag is developed using poetry. However, in projects, we mostly use conda. So it would be nice to build a conda package as part of the CI and to test it with a little test bench that runs for a combination of multiple pandas and sqlalchemy versions.