This PR replaces direct asyncpg usage with AsyncPGDriver across PgQueuer. The new driver centralizes database interactions, improving code modularity and simplifying future enhancements.
Major Changes:
Introduced AsyncPGDriver in db.py, implementing database operations.
Refactored QueueManager, CLI tools, and tests to use the new driver.
This update streamlines database handling and enhances the maintainability of the codebase.
NOTE; Major performance drop(6k -> 1.5k), a followup PR with batched queries is needed (Have a poc showing 6k -> ~13k job per second)
This PR replaces direct
asyncpgusage withAsyncPGDriveracross PgQueuer. The new driver centralizes database interactions, improving code modularity and simplifying future enhancements.Major Changes:
AsyncPGDriverindb.py, implementing database operations.QueueManager, CLI tools, and tests to use the new driver.This update streamlines database handling and enhances the maintainability of the codebase.
NOTE; Major performance drop(6k -> 1.5k), a followup PR with batched queries is needed (Have a poc showing 6k -> ~13k job per second)