Closed windiana42 closed 5 months ago
@NMAC427 FYI: we make examples using code based configuration and duckdb as a containerless database more prominent in documentation.
Seems reasonable.
Though I would probably rename get_basic_pipedag_config
to create_basic_pipedag_config
.
Since this PR already touched example code and configuration widely, I also included a switch from ZookeeperLockManager to DatabaseLockManager for default tests. DatabaseLockManager is the one I would recommend to everyone who is working with a database target that supports it (mssql, postgres, db2).
Currently, the only way to configure pipedag is to provide a configuration yaml. More alternatives including configuration in code should be provided.
Checklist
docs/source/changelog.md
entry