Update ALB algorithm from round robin to least outstanding requests
Context for reviewers
Testing instructions, background context, more in-depth details of the implementation, and anything else you'd like to call out or ask reviewers. Explain how the changes were verified.
Based on looking at the metric graphs from today’s (2023-05-05) bug bash, we think it would be better to change the load balancing algorithm from round robin to least outstanding requests.
Testing
Screenshots, GIF demos, code examples or output to help show the changes working as expected. ProTip: you can drag and drop or paste images into this textbox.
Ticket
https://wicmtdp.atlassian.net/browse/PRP-336
Changes
Context for reviewers
Based on looking at the metric graphs from today’s (2023-05-05) bug bash, we think it would be better to change the load balancing algorithm from round robin to least outstanding requests.
Testing