mher / flower

Real-time monitor and web admin for Celery distributed task queue
https://flower.readthedocs.io
Other
6.5k stars 1.09k forks source link

Terminating celery-flower pod caused old tasks to be re-queued #1406

Open jrochette opened 3 weeks ago

jrochette commented 3 weeks ago

Describe the bug Running celery-flower in a kubernetes cluster. Restarting the pod with a kubectl delete pod ... command caused many old completed tasks to be re-queued. Maybe it's the expected behaviour? I'm trying to understand why this happens. I'm running celery with a Redis broker and the following settings

CELERY_TASK_ACKS_LATE = True
CELERY_WORKER_PREFETCH_MULTIPLIER = 1

To Reproduce

Expected behavior I would not expect any tasks to be re-queued upon terminating flower

System information python -c 'from flower.utils import bugreport; print(bugreport())'

flower   -> flower:1.2.0 tornado:6.2 humanize:4.3.0
software -> celery:5.2.7 (dawn-chorus) kombu:5.2.4 py:3.10.6
            billiard:3.6.4.0 redis:4.3.4
platform -> system:Linux arch:64bit
            kernel version:5.10.225-213.878.amzn2.x86_64 imp:CPython
loader   -> celery.loaders.app.AppLoader
settings -> transport:rediss results:disabled

deprecated_settings: None