This might benefit from explicit signaling from a client about affinity for different requests so that they end up routed to the same back end. That might be separable work, but if an mechanism existed that improved the chances that certain sets of requests ended up in the same place that would help. This work would want to point at that and make some fairly firm recommendations or at least establish expectations around the use of any affinity mechanisms (i.e., use it or be prepared for failures).
This might benefit from explicit signaling from a client about affinity for different requests so that they end up routed to the same back end. That might be separable work, but if an mechanism existed that improved the chances that certain sets of requests ended up in the same place that would help. This work would want to point at that and make some fairly firm recommendations or at least establish expectations around the use of any affinity mechanisms (i.e., use it or be prepared for failures).