bug: evidence of max concurrent workers not being honored

brigadecore / brigade

Event-driven scripting for Kubernetes

https://brigade.sh/

Apache License 2.0

2.4k stars 247 forks source link

bug: evidence of max concurrent workers not being honored #1917

Open krancour opened 2 years ago

krancour commented 2 years ago

Max concurrent workers is set to 3... what's going on?

Screen Shot 2022-04-08 at 12 38 10 PM

krancour commented 2 years ago

I have a suspicion about what's happening.

Success or failure, these jobs do eventually finish.

I suspect that some (unlogged) error is causing the finite number of goroutines that the scheduler uses to constrain max concurrency to sometimes give up on watching a worker -- then it becomes free to grab another event off any one of the project queues.

This is speculation at this juncture, but it's a plausible explanation.