pydiverse / pydiverse.pipedag

A data pipeline orchestration library for rapid iterative development with automatic cache invalidation allowing users to focus writing their tasks in pandas, polars, sqlalchemy, ibis, and alike.
https://pydiversepipedag.readthedocs.io/
BSD 3-Clause "New" or "Revised" License
12 stars 2 forks source link

Move primary key generation for mssql backend after completely filling a table. #190

Closed windiana42 closed 2 months ago

windiana42 commented 2 months ago

For mssql backend, moved string type changes for index columns after creation of empty table and before filling it. We were not sure at first which one would be faster.

Checklist