ansible / awx

AWX provides a web-based user interface, REST API, and task engine built on top of Ansible. It is one of the upstream projects for Red Hat Ansible Automation Platform.
Other
13.5k stars 3.34k forks source link

concurrent jobs limit #15167

Closed zholbrook closed 1 week ago

zholbrook commented 2 weeks ago

Please confirm the following

Feature type

New Feature

Feature Summary

I would like to be able to allow concurrent jobs on a workflow or job template but also set the max number of concurrent jobs. Then after X number of jobs start queuing them.

Select the relevant components

Steps to reproduce

Any workflow as the concurrent jobs option

Current results

In EKS after about 150 workflow jobs with 10 job tasks under i start to have job failures

Sugested feature result

All to queue any number of workflow jobs but only X number will run at any give time.

Additional information

No response

marek1712 commented 1 week ago

If your jobs run under common Instance Group, you could assign max number of forks and concurrent jobs. See the LINK. Does it help in your case?

zholbrook commented 1 week ago

Its not exactly what i want but i think it will be good enough to use the instance group limits. thanks!