pydiverse / pydiverse.pipedag

A data pipeline orchestration library for rapid iterative development with automatic cache invalidation allowing users to focus writing their tasks in pandas, polars, sqlalchemy, ibis, and alike.
https://pydiversepipedag.readthedocs.io/
BSD 3-Clause "New" or "Revised" License
27 stars 3 forks source link

DatabaseLockManager requires schema creation permission #95

Closed QuantCo-mr-T closed 1 year ago

QuantCo-mr-T commented 1 year ago

In DB2 it is possible to setup implicit schema creation without the permission to explicitly run "CREATE SCHEMA". Pipedag supports this operation mode with DB2 and ReadViews Technique. In this case the DatabaseLockManager also must avoid executing CREATE SCHEMA. Instead it can simply create tables with the given schema. Worst case, we can also make it an option of the DatabaseLockManager.