janbjorge / PgQueuer

PgQueuer is a Python library leveraging PostgreSQL for efficient job queuing.
https://pgqueuer.readthedocs.io/en/latest/index.html
MIT License
211 stars 2 forks source link

Add job-buffer / batched job update inserts #34

Closed janbjorge closed 3 weeks ago

janbjorge commented 4 weeks ago
(pgq) ➜  PgQueuer git:(batch-update) ✗ PGUSER=testuser PGPASSWORD=testpassword PGDATABASE=testdb python3 tools/benchmark.py -dq 10 -t5
Settings:
Timer:                  5.0 seconds
Dequeue:                10
Dequeue Batch Size:     10
Enqueue:                1
Enqueue Batch Size:     20

Queue size: 0
Queue size: 1450
Queue size: 685
Queue size: 217
Queue size: 233
Queue size: 219
Queue size: 261
Queue size: 250
Queue size: 191
Queue size: 199
Jobs per Second: 14.69k