pydiverse / pydiverse.pipedag

A data pipeline orchestration library for rapid iterative development with automatic cache invalidation allowing users to focus writing their tasks in pandas, polars, sqlalchemy, ibis, and alike.
https://pydiversepipedag.readthedocs.io/
BSD 3-Clause "New" or "Revised" License
19 stars 3 forks source link

feat(): add upload_table and download_table functions to PandasTableHook #196

Closed DominikZuercherQC closed 4 months ago

DominikZuercherQC commented 4 months ago

Add an easy way to customize upload and download behavior of pandas and polars tables to/from the table store