How to prioritize a celery task chain to complete before starting new builds

[ClaytonAstrom]

Context

Something that isn't clear in the administration is the following situation -

• Queue a series of 10 builds
• Build 1 is picked up with CONDA_PACK enabled
• Build 2 starts, Build 3 starts, ..., Build 10 starts
• Build 1 CONDA_PACK starts

Why is the rest of the chain put behind all the other builds? Would the worker_prefetch_limit help?

Value and/or benefit

It's difficult to have a high volume queue in flight

Anything else?

No response

[ClaytonAstrom]

Some clarification - this is true even for a single worker node

[ClaytonAstrom]

Hm, this may be something that was resolved with #473 , my mistake!

[pavithraes]

Thanks for opening this issue and following up! 🌻