polars dataframe needs write_parquet not to_parquet

pydiverse / pydiverse.pipedag

A data pipeline orchestration library for rapid iterative development with automatic cache invalidation allowing users to focus writing their tasks in pandas, polars, sqlalchemy, ibis, and alike.

https://pydiversepipedag.readthedocs.io/

BSD 3-Clause "New" or "Revised" License

15 stars 2 forks source link

polars dataframe needs write_parquet not to_parquet #100

Closed windiana42 closed 1 year ago

windiana42 commented 1 year ago

PolarsParquetTableHook.materialize function includes table.obj.table.obj.to_parquet(path). This should be table.obj.table.obj.write_parquet(path)

windiana42 commented 1 year ago

https://github.com/pydiverse/pydiverse.pipedag/commit/f6492e34ec478c1ffd3a0dd04d0b6a57a12a952c#diff-efbdf1197b2c0218f2e0a35a8441695d8b7cf7ff994c1834ffe21b5f6448ceea

NMAC427 commented 1 year ago

Fixed by 6d45c0d60be8be16a15bb3d5d143244f9f2a80c0