Job queue in k8s. Mutliple pods == duplicate jobs?

levibostian / ExpressjsBlanky

Blank Express.js project to get up and running FAST.

MIT License

7 stars 0 forks source link

Job queue in k8s. Mutliple pods == duplicate jobs? #29

Closed levibostian closed 4 years ago

levibostian commented 4 years ago

If I have 5 pods running for an application in k8s. If a new job is created in the bull job queue in pod 1, will bull only trigger that job to be executed on 1 of those pods or will all 5 then run?

levibostian commented 4 years ago

I tested this by...

Create a very simple bull job that just logs to the console.
Run my app in minikube with 3 replicas.
Add job to be executed. See in console how many times the console ran which indicates how many apps ran the job.

The results: Only 1 pod ran the job. This issue is not an issue.