Concurrent calls can hit the same throttling limit. We want separate threads that hit the same throttling limit to co-respect the throttling limit.
Throttling limits are workload specific. This means that we need to manage retry queues based on calls to the same backend. We will need a heuristic, workload map, and/or regex to determine whether a retry call needs to be added to a queue.
This will require investigation and design spec. The design will be applicable across platforms but we will implement for .Net.
AB#7330
Concurrent calls can hit the same throttling limit. We want separate threads that hit the same throttling limit to co-respect the throttling limit.
Throttling limits are workload specific. This means that we need to manage retry queues based on calls to the same backend. We will need a heuristic, workload map, and/or regex to determine whether a retry call needs to be added to a queue.
This will require investigation and design spec. The design will be applicable across platforms but we will implement for .Net. AB#7330